-- Logs begin at Mon 2022-02-21 00:17:29 UTC, end at Mon 2022-02-21 01:54:25 UTC. -- Feb 21 00:48:45.613954 dv-cinder-813227-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 21 00:48:45.624396 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 00:48:45 2022] *** Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: nodename: dv-cinder-813227-6-iscsi Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: machine: x86_64 Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: clock source: unix Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: pcre jit disabled Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: detected number of CPU cores: 4 Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: current working directory: / Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: detected binary path: /usr/bin/uwsgi-core Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: your processes number limit is 47680 Feb 21 00:48:45.627223 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: your memory page size is 4096 bytes Feb 21 00:48:45.627963 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: detected max file descriptor number: 2048 Feb 21 00:48:45.627963 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: lock engine: pthread robust mutexes Feb 21 00:48:45.627963 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: thunder lock: enabled Feb 21 00:48:45.627963 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 21 00:48:45.627963 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 00:48:45.672524 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: Python main interpreter initialized at 0x559a37f949c0 Feb 21 00:48:45.672524 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: python threads support enabled Feb 21 00:48:45.672524 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: your server socket listen backlog is limited to 100 connections Feb 21 00:48:45.672524 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: your mercy for graceful operations on workers is 90 seconds Feb 21 00:48:45.673418 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 00:48:45.673495 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: *** Operational MODE: preforking *** Feb 21 00:48:45.673751 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: *** uWSGI is running in multiple interpreter mode *** Feb 21 00:48:45.673751 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: spawned uWSGI master process (pid: 79578) Feb 21 00:48:45.673965 dv-cinder-813227-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 21 00:48:45.675049 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: spawned uWSGI worker 1 (pid: 79590, cores: 1) Feb 21 00:48:45.675049 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: spawned uWSGI worker 2 (pid: 79591, cores: 1) Feb 21 00:48:45.675049 dv-cinder-813227-6-iscsi devstack@keystone.service[79578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 00:48:51.587242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:48:51.587242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: from cryptography.utils import int_from_bytes Feb 21 00:48:51.588406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:48:51.588406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: from cryptography.utils import int_from_bytes Feb 21 00:48:51.621895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:48:51.621895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: from cryptography.utils import int_from_bytes Feb 21 00:48:51.622441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 00:48:51.622441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: from cryptography.utils import int_from_bytes Feb 21 00:48:51.634516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 00:48:51.634738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 00:48:51.634914 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] command line args: [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 00:48:51.635188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 00:48:51.635365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ================================================================================ {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 00:48:51.635622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] admin_token = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.635894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] config_dir = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.636089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.636271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] config_source = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.636452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] debug = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.636654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.637134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.637262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.637439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.637692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.637930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.638111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_config_append = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.638276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.638498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_dir = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.638635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_file = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.638874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.639125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.639378 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.639628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.639811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.640020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.640270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.640519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.640756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.641030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.641774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.642009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.642259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.642509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.642786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.643278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.643463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] publish_errors = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.643696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.643965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.644164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.644398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.644639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.644877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] standard_threads = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.645111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.645359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.645538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.645716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] use_journal = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.645893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] use_json = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.646071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] use_stderr = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.646246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] use_syslog = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.646480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.646739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.646980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.647243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.647485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.647738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.648003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.648258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.648496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.648749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.648996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.649250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.649486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.649733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.649971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.650219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.650469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.650706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.650964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.651220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.651466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.651704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.651989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.652255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.652510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.652762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.652993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.653224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.653456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.653692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.653942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.654192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.654425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.654665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.654913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.655163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.655402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.655652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.655918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.656162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.656401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.656707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.657461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.657695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.657929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.658170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.658422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.658657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.658897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.659130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.659369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.659607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.659870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.660110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.660350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.660590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.660830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.661069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.661307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.661538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.661790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.662028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.662267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.662500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.662763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.663002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.663236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.663479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.663715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.664013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.664255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.664507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.664759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.664997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.665236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.665473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.665723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.665964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.666219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.666451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.666690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.666928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.667165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.667404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.667641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.667928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.668176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.668421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.668664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.668909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.669040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 00:48:51.669166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.669241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 00:48:51.669375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.669490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] command line args: [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 00:48:51.669614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.669769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 00:48:51.669847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.669951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ================================================================================ {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 00:48:51.670068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.670211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] admin_token = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.670301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.670465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] config_dir = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.670543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.670656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.670734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.670842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] config_source = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.670972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.671051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] debug = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.671210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.671348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.671464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.671544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.671616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.671685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.671897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.672030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.672176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.672324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.672474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.672585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.672710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.external = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.672901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_config_append = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.673070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.673228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.673315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.673506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.673596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_dir = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.673760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_file = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.673845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.password = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.674008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.674112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] auth.token = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.674267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.674398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.674508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.674586 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.674761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.674849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.674968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.675054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.675172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.675250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.675375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.675454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.675604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.675686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.675858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.675943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.676105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.676189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.676343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.676432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.676582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.676661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.676837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.676916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.677088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.677166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.677338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.677459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.677582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.677839 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.677923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.91/identity {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.678053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] publish_errors = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.678138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.678293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.678380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.678529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.678609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.678712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.678866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.678965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.679100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.679207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.679351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.679450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] standard_threads = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.679614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.679706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.679873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.679967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.680117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.680200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.680284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] use_journal = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.680363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.680463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] use_json = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.680604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.680683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] use_stderr = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.680808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] use_syslog = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.680886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 00:48:51.681215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.681965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.682960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.683969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.684959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.685998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.686186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.686272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.686432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.686549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.686758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.686837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.687811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.688471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.688622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.688737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.688859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.689923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.690995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.691929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.692955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693831 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.693903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.694882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.695821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.696926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.697980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.698962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.699633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.699714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.699797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.699910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.700965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.701954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.702943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.703032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.703191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.703272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.703432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.706562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.706677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.706774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.706774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.706914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.707941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.708929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] role.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] role.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.709993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.external = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.password = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.710928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] auth.token = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711177 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.711987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.712178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.712264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.712395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.712495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.712650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.712736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.713987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.714963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.715980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.716885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717378 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.717982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.718975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.719976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.729894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.connection = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.730978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.731999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.732916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.733661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.734733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.735394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.736754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.737011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.737269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.737524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.737763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.738019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.738263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.738513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.738756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.738998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.739250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.739504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.739748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.740062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.740305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.740567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.740865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.741104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.741349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.741602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.741851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.742089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.742331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.742577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.742834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.743094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.743330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.743587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.743884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.744174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.744428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.744675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.744948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.745163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] role.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.745418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] role.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.745656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.745914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.746170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.746467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.746723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.746974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.747227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.747480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.747735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.748124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.748124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.749911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.749911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.749911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.749911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.749911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.749911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.750276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.750897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.751337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.751822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.752156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.752424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.752679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.752922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.753168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.753409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.753672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.753937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.754194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.754440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.754684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.754923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.755165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.755456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.755717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.755992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.756258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.756585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.756838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.757090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.757352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.757608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.757852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.758099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.758351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.758606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.758732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.758872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.758998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.759127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.759253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.759383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.759627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.759923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.connection = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.760179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.760436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.760683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.760931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.761175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.761418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.761662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.761904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.762156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.762397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.762649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.762890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.763144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.763386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.763637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.763910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.764149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.764391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 00:48:51.764568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 00:48:51.768652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.797137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.797410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.798888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.799130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.799370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.808213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.827846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.828102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.852908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.869098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.903463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.903665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.906750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.907208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.970448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.970732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.970877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.971094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.971383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.971537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.971749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.972012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.972245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.972472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.972697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:51.972917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.004258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.004494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.004612 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.004727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.004892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.004977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.005784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.006003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.017507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.017923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.030208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.030441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.030672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.030754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.030899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.030983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.031140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.031233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.031334 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.031426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.031549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79590) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.031693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.032122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.032531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79591) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 00:48:52.048731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.048944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 00:48:52.049283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.049394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.049479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 00:48:52.049602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 00:48:52.049938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.050027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.050144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 00:48:52.050228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.050420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.050515 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.050702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.050879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.051144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.051406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.061314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.061591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.061860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.062140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.062225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.062485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.062761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.063701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.070760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.072091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.074147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.074424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.074704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.074991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.075275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.075440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.075526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.075723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.075808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.076938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.077129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.077411 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.077681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.077955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.078224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.103594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.105215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.105491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.105773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.107354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.107633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.111294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.111569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.111867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.113753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.114034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.114319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.119184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.119467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.121731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.122018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.123893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.124181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.124463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.124741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.125016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.125290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.125720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.125989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.126943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.127232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.127514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.127794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.128223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.128500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.128773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.129094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.144876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.145155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.148469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.148750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.149942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.153323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.153625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.153875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.158040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.158351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.159592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.163164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.163496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.166777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.167069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.167168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.167343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.167631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.169392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.169392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.170682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.170989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.171302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.171572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.171870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.172154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.187051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.187334 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.187599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.187910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.191779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.192090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.192362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.192626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.195642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.197354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.197633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.200562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.200666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.200924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.201342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.201631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.201910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.202258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.202536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.206446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.206728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.207143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.207442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.207722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.215888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.216171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.216450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.216729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.217008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.217292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.217568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.222103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.222385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.222664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.222956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.223250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.223540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.223818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.237084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.240291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.243365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.243559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.245157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.246605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.250059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.252285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.349304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.349587 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.349873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.357225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.357358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.357583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.357855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.358843 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.362041 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.362330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.362613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.362889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.365558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.367133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.370320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.370611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.370962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.371246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.372005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.372292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.372570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.381177 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.381473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.381755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.384858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79590) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.385146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.385429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.385704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.385972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.386257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.386530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.386929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.387249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.387564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.387869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.388147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.388415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.388677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79590) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.389755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79591) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 00:48:52.390037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.390322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.390601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.390879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.391715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.392252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.392692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.393006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.393255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.393533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.393808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.394080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.394353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79591) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 00:48:52.427120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559a37f949c0 pid: 79590 (default app) Feb 21 00:48:52.430564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701298c5-d0bf-436d-86a0-c81b0cf909e2 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:48:52.430867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701298c5-d0bf-436d-86a0-c81b0cf909e2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:48:52.431145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701298c5-d0bf-436d-86a0-c81b0cf909e2 None None] PATH_INFO: `/v3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:48:52.433424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559a37f949c0 pid: 79591 (default app) Feb 21 00:48:52.435278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1/1] 10.222.0.91 () {50 vars in 791 bytes} [Mon Feb 21 00:48:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:02.529393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d3b4a-4b90-4d0a-b6b5-13bf0edd3486 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:02.529962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d3b4a-4b90-4d0a-b6b5-13bf0edd3486 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:02.529962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d3b4a-4b90-4d0a-b6b5-13bf0edd3486 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:02.535731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1/2] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:02.541485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:02.541917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:02.542031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:02.572807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG oslo_db.sqlalchemy.engines [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:49:02.758083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG passlib.handlers.bcrypt [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79590) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 00:49:02.758498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG passlib.handlers.bcrypt [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79590) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 00:49:02.814741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:02.816363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:02.941397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 2/3] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:03.092943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d3b4a-4b90-4d0a-b6b5-13bf0edd3486 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:03.128019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG oslo_db.sqlalchemy.engines [None req-8d0d3b4a-4b90-4d0a-b6b5-13bf0edd3486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 00:49:03.257937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d3b4a-4b90-4d0a-b6b5-13bf0edd3486 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:03.262353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:03.263017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:03.263305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:03.263585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:03.272115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:03.322401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 00:49:03.322777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbedaec-7bdb-42e4-9a75-c074b1959606 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:03.333141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 2/4] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:03.339494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:03.354483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39e905-1e47-414c-b713-a00dc7204941 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:03.359158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:03.360311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:03.360603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:03.360882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] PATH_INFO: `/v3/projects/433e9f18a6614ea59825abd58da308b1` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:03.362389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] RBAC: Authorizing `identity:get_project(project_id=433e9f18a6614ea59825abd58da308b1)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:03.414360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 00:49:03.414760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37af625-720e-4313-a6be-c8ba1215f88a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:03.419510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 3/5] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:03 2022] GET /identity/v3/projects/433e9f18a6614ea59825abd58da308b1 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:05.707589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9d5c-a02f-44a0-a161-ce3ffce05db9 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:05.708119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9d5c-a02f-44a0-a161-ce3ffce05db9 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:05.708119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9d5c-a02f-44a0-a161-ce3ffce05db9 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:05.712956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 3/6] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:05.718407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:05.718825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:05.719020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:05.738223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:05.739723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:05.747612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 4/7] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:05.770544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a9d5c-a02f-44a0-a161-ce3ffce05db9 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:05.783570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a9d5c-a02f-44a0-a161-ce3ffce05db9 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:05.788021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff92e91-dbc1-44d8-a342-951f8e6b7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:05.788680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff92e91-dbc1-44d8-a342-951f8e6b7842 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:05.788971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff92e91-dbc1-44d8-a342-951f8e6b7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:05.789255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff92e91-dbc1-44d8-a342-951f8e6b7842 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:05.797119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff92e91-dbc1-44d8-a342-951f8e6b7842 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:05.798906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff92e91-dbc1-44d8-a342-951f8e6b7842 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:05.807703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 4/8] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:05.813466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:05.822331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7601de-79c8-4936-82d9-a1e96ec018e1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:05.826731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb6667-8fda-41ce-b2e5-7d43ea500cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:05.827575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6667-8fda-41ce-b2e5-7d43ea500cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:05.828391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6667-8fda-41ce-b2e5-7d43ea500cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:05.828672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb6667-8fda-41ce-b2e5-7d43ea500cf6 admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:05.830052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6667-8fda-41ce-b2e5-7d43ea500cf6 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:05.831887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb6667-8fda-41ce-b2e5-7d43ea500cf6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:05.833422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 5/9] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:05 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:08.185429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01725aa4-9c6e-4c9b-8f21-5d1e2071b26d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.185978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01725aa4-9c6e-4c9b-8f21-5d1e2071b26d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.185978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01725aa4-9c6e-4c9b-8f21-5d1e2071b26d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.188360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 5/10] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:08.193573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.193999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.194132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.212658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:08.213841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:08.221828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 6/11] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:08.245138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01725aa4-9c6e-4c9b-8f21-5d1e2071b26d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.257894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01725aa4-9c6e-4c9b-8f21-5d1e2071b26d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.262163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde15f69-40e1-4513-8c14-19f3f5323e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.262964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde15f69-40e1-4513-8c14-19f3f5323e36 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.263250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde15f69-40e1-4513-8c14-19f3f5323e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.263525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde15f69-40e1-4513-8c14-19f3f5323e36 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.279984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde15f69-40e1-4513-8c14-19f3f5323e36 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:08.286925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-cde15f69-40e1-4513-8c14-19f3f5323e36 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:08.288165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 6/12] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:08.293976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.299816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc7294-4b3a-4855-902d-13a0497ea88d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.300201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc7294-4b3a-4855-902d-13a0497ea88d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.300419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc7294-4b3a-4855-902d-13a0497ea88d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.302156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 7/13] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:08.303623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e06a5e-169a-4954-8b25-3811fb3d3119 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.307206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.307495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.307777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.308270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.308935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.309221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.309501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.310260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:08.310563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:08.312995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:08.312995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:08.312995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:08.313868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:08.329034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 7/14] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:08.334630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.346022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88216ace-d9be-4c45-bf5f-3e703ea22d6b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.348500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG passlib.handlers.bcrypt [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79591) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 00:49:08.348919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG passlib.handlers.bcrypt [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79591) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 00:49:08.351463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.352351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.352644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.352949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.354363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:08.356751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:08.358045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 8/15] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:08.363377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.373054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565228e7-7524-4595-bec7-de2bbed9982e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.378312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.379114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.379402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.379684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.380890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:08.382554 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:08.384145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 9/16] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:08.389420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.396345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:08.397604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:08.399585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e1773-409d-4c2c-b0ad-51524396990c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.404093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.404716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.405002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.405331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.406274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.domain.id=default, user.id=b9a601927c06447bab4cb7cd0ec12a02) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:08.406823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:08.407873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:08.407873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:08.407873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:08.409090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:08.416284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 10/17] 10.222.0.91 () {56 vars in 1343 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/role_assignments?user.id=b9a601927c06447bab4cb7cd0ec12a02&scope.domain.id=default&role.id=30d31529b5824c178844aea14bad4358 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:08.419719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 8/18] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:08.444189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.455458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b52f-fa0a-4d83-85b9-7be9b0b90360 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.460196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e949-34d5-40e2-896e-8d17b6a1649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.460863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e949-34d5-40e2-896e-8d17b6a1649a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.461153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e949-34d5-40e2-896e-8d17b6a1649a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.461436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e949-34d5-40e2-896e-8d17b6a1649a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.471153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e949-34d5-40e2-896e-8d17b6a1649a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:08.473034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e949-34d5-40e2-896e-8d17b6a1649a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:08.483124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 11/19] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:08.489189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:08.498977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e06cf-9ce9-44af-b5a7-64fe12a1497f None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:08.504497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a384d-65ae-4774-97be-b44d20f81906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:08.505714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a384d-65ae-4774-97be-b44d20f81906 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:08.505961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a384d-65ae-4774-97be-b44d20f81906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:08.506244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a384d-65ae-4774-97be-b44d20f81906 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:08.507886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a384d-65ae-4774-97be-b44d20f81906 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:08.509661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a384d-65ae-4774-97be-b44d20f81906 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:08.511326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 9/20] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:11.244125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe3212-25c9-45c9-ad9d-64ede27898b1 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.245161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe3212-25c9-45c9-ad9d-64ede27898b1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.245710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe3212-25c9-45c9-ad9d-64ede27898b1 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.248310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 12/21] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:11.254227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b67f-c99c-4e17-88ca-c7f613ca6be5 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.255260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b67f-c99c-4e17-88ca-c7f613ca6be5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.255782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b67f-c99c-4e17-88ca-c7f613ca6be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.277800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6d74b67f-c99c-4e17-88ca-c7f613ca6be5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:11.279372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6d74b67f-c99c-4e17-88ca-c7f613ca6be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:11.288909 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 10/22] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:11.313288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe3212-25c9-45c9-ad9d-64ede27898b1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.326133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe3212-25c9-45c9-ad9d-64ede27898b1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.331302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.332282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.332806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.333295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.334248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:11.335463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:11.335463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:11.335463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:11.336763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:11.399820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22af3-cc83-4b91-ac73-f2467a3cd0b3 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.400445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22af3-cc83-4b91-ac73-f2467a3cd0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.400932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22af3-cc83-4b91-ac73-f2467a3cd0b3 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.403062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 11/23] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:11.409514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.410102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.410580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.435478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:11.437131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:11.470666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 12/24] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:11.509632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.523857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045629c-b0ac-4bcf-b9af-a15ae4c56014 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.532575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.533588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.534076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.534536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.568262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:11.570542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:11.593468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 13/25] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 00:49:11 2022] POST /identity/v3/roles => generated 219 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:11.599138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:49:11.601118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 13/26] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:11.610269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.630576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb6f1-9592-4213-9b6d-79ac26eaa0f1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.640396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.641086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.641371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.641650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.642395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:11.642704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:11.643948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:11.643948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:11.643948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:11.644879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771004b4-5bdd-426f-ac8e-4f6f2e792bc2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:11.676321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 14/27] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:11.681925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.693433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2536d-cd4e-470d-96ec-d1c0d2107065 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.693737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2536d-cd4e-470d-96ec-d1c0d2107065 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.694015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2536d-cd4e-470d-96ec-d1c0d2107065 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.696268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 15/28] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:11.698690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2adac5-742f-4e30-97ff-d8b39824abf4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.701298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.701590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.701871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.706487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.707550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.708097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.708709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.709652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:11.711712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:11.711712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:11.711712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:11.713598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:11.736074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:11.736074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:11.758686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 16/29] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:11.798953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.809355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf9ec-3154-4e7b-97af-6285a321233a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.820398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.821213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.821500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.821781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.846866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:11.853927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:11.855585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 17/30] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:11.861806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.876259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63397ca3-e065-471c-8308-6f73c801201f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.883917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.884625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.884953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.885239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.886063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:11.886420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:11.892381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:11.920044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 18/31] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:11.924298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.947414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195584-4709-41e0-8c9d-2565a232f265 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:11.969169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:11.970142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:11.970432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:11.970710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:11.972018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:11.973874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:11.975786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 19/32] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:11 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:11.981074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:11.998400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 14/33] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:49:11 2022] POST /identity/v3/projects => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:12.006217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60336ee-fe2e-47ef-9abc-aa21dfc0b3ed admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:12.079071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8578-61b1-4ef8-9716-e36dc4c3441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:12.080227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8578-61b1-4ef8-9716-e36dc4c3441f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.080718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8578-61b1-4ef8-9716-e36dc4c3441f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.081178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8578-61b1-4ef8-9716-e36dc4c3441f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.082635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8578-61b1-4ef8-9716-e36dc4c3441f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:12.084649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8578-61b1-4ef8-9716-e36dc4c3441f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:12.086582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 20/34] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:12.092912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:12.106713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d524e5-2069-4852-a121-6d12d2d4a3f7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:12.112984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:12.114202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.114680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.115183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] PATH_INFO: `/v3/domains/default/users/b9a601927c06447bab4cb7cd0ec12a02/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.118218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b9a601927c06447bab4cb7cd0ec12a02, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:12.119721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:12.119721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:12.119721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:12.122126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37849e7f-a163-4b83-abef-e5c7c7b8b4ea admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:12.126895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de315-df89-4a79-beb7-a94f4c217701 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.127473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de315-df89-4a79-beb7-a94f4c217701 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.127986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106de315-df89-4a79-beb7-a94f4c217701 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.130028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 21/35] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:12.136108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.136748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.137216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.158633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:12.160229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:12.172495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 22/36] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:12.199615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:12.211481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36f984-419e-4cda-9142-6bbda512e61a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:12.216994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5d065-7a36-4a3a-8a3b-598043428a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:12.217786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5d065-7a36-4a3a-8a3b-598043428a73 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.218721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5d065-7a36-4a3a-8a3b-598043428a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.219115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5d065-7a36-4a3a-8a3b-598043428a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.223030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5d065-7a36-4a3a-8a3b-598043428a73 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:12.225174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5d065-7a36-4a3a-8a3b-598043428a73 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:12.240183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 15/37] 10.222.0.91 () {58 vars in 1382 bytes} [Mon Feb 21 00:49:12 2022] PUT /identity/v3/domains/default/users/b9a601927c06447bab4cb7cd0ec12a02/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:12.357848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 23/38] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 00:49:12 2022] POST /identity/v3/roles => generated 225 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:49:12.832507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c6d7-32db-496b-ba25-ee0af69f984a None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.833045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c6d7-32db-496b-ba25-ee0af69f984a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.833124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8c6d7-32db-496b-ba25-ee0af69f984a None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.834978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 16/39] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:12.840387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8063-0889-4245-8450-670fd6369131 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.840688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8063-0889-4245-8450-670fd6369131 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.840976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8063-0889-4245-8450-670fd6369131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.858648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-92af8063-0889-4245-8450-670fd6369131 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:12.859873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-92af8063-0889-4245-8450-670fd6369131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:12.908760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d5141-7320-4786-ad56-69a19665a4d9 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.909060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d5141-7320-4786-ad56-69a19665a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.909340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d5141-7320-4786-ad56-69a19665a4d9 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.911099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 17/40] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:12.916208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.916507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.916789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.917895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 24/41] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:12.937248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:12.939106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:12.941786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8063-0889-4245-8450-670fd6369131 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:12.947394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 18/42] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:12.951161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8063-0889-4245-8450-670fd6369131 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:12.956398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:12.957372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.957833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.958345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.959691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:12.961590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:12.963922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 25/43] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:12.969365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:12.973218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:12.979018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46959ffa-decb-42ef-bbb6-5990913a3912 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:12.983016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99ef8e-400d-43d8-aaab-111b7d343860 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:12.983895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fcf44-b502-43af-b33e-af5d5fbb832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:12.984568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fcf44-b502-43af-b33e-af5d5fbb832b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.984840 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fcf44-b502-43af-b33e-af5d5fbb832b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.985118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fcf44-b502-43af-b33e-af5d5fbb832b admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.985827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fcf44-b502-43af-b33e-af5d5fbb832b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:12.987767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fcf44-b502-43af-b33e-af5d5fbb832b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:12.987898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d5f6c-11d9-465d-a297-6f3c39063ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:12.988530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5f6c-11d9-465d-a297-6f3c39063ddf admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:12.988822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5f6c-11d9-465d-a297-6f3c39063ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:12.989105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d5f6c-11d9-465d-a297-6f3c39063ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:12.989847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5f6c-11d9-465d-a297-6f3c39063ddf admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:12.991451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d5f6c-11d9-465d-a297-6f3c39063ddf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:13.067927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 26/44] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 00:49:12 2022] POST /identity/v3/roles => generated 223 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:49:13.102605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 19/45] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:49:12 2022] POST /identity/v3/projects => generated 312 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:49:14.616703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a08e9-9870-4f17-9d72-3e097ed0fc2e None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.617222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a08e9-9870-4f17-9d72-3e097ed0fc2e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.617222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a08e9-9870-4f17-9d72-3e097ed0fc2e None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.619113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 27/46] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:14.624284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.624811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.625247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.643786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:14.645036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:14.714822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 20/47] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:14.739261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a08e9-9870-4f17-9d72-3e097ed0fc2e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:14.751416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a08e9-9870-4f17-9d72-3e097ed0fc2e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:14.755899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:14.756681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.756995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.757279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.768617 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:14.775412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:14.776616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 28/48] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:14.782996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:14.792132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ca03b-b57d-41bb-951f-1e4b8addad7a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:14.797038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:14.797703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.798035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.798323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.799085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:14.799403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:14.800448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:14.800448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:14.800448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:14.801367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:14.814502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 21/49] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:14.820277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:14.831534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a2df-09d2-4394-9691-4d8dce001ccd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:14.836056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:14.837222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.837555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.837799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.839018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:14.840902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:14.842543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 29/50] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:14 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:14.848763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:14.858621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae19de9-a99f-4364-a25f-826432910d47 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:14.863238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbfaa-b470-4a9d-8a44-d0ebe0a8206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:14.864041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbfaa-b470-4a9d-8a44-d0ebe0a8206b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.864357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbfaa-b470-4a9d-8a44-d0ebe0a8206b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.864687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbfaa-b470-4a9d-8a44-d0ebe0a8206b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.865885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cbfaa-b470-4a9d-8a44-d0ebe0a8206b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:14.867671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cbfaa-b470-4a9d-8a44-d0ebe0a8206b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:14.869305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 22/51] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:14.875130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:14.885262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2a29-1888-4692-b0ec-d437217d92a1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:14.890639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:14.891305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:14.891643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:14.891939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:14.892786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.domain.id=default, user.id=b9a601927c06447bab4cb7cd0ec12a02) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:14.893100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:14.895038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f3c48-0ff0-4389-9f17-e1aedd1aa06e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:14.901313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 30/52] 10.222.0.91 () {56 vars in 1343 bytes} [Mon Feb 21 00:49:14 2022] GET /identity/v3/role_assignments?user.id=b9a601927c06447bab4cb7cd0ec12a02&scope.domain.id=default&role.id=30d31529b5824c178844aea14bad4358 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:15.444588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16790a9f-5ecf-4ba7-b695-401932dbb8a2 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:15.444882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16790a9f-5ecf-4ba7-b695-401932dbb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:15.445195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16790a9f-5ecf-4ba7-b695-401932dbb8a2 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:15.447004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 23/53] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:15.452446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:15.452743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:15.453028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:15.470528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:15.471718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:15.479372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 31/54] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:15.503650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16790a9f-5ecf-4ba7-b695-401932dbb8a2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:15.516407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16790a9f-5ecf-4ba7-b695-401932dbb8a2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:15.520746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77193b56-4f57-48d2-bd95-8f0fd552046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:15.521657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193b56-4f57-48d2-bd95-8f0fd552046f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:15.521947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193b56-4f57-48d2-bd95-8f0fd552046f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:15.522230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77193b56-4f57-48d2-bd95-8f0fd552046f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:15.523421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193b56-4f57-48d2-bd95-8f0fd552046f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:15.525173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77193b56-4f57-48d2-bd95-8f0fd552046f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:15.526752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 24/55] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:15.532143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:15.541031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8ed4a-4a04-4e08-a669-6356b86a47df None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:15.545477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:15.546709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:15.547005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:15.547280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:15.548032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:15.549046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:15.549046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:15.549046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:15.550294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072aff4-9aaa-48d3-a18c-23ee6b7aba17 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:15.633937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 32/56] 10.222.0.91 () {60 vars in 1161 bytes} [Mon Feb 21 00:49:15 2022] POST /identity/v3/projects => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:18.008276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec88dc-02c8-4394-aec7-8465478e1d91 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:18.008902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec88dc-02c8-4394-aec7-8465478e1d91 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:18.008902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec88dc-02c8-4394-aec7-8465478e1d91 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:18.010605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 25/57] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:18.016075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:18.016520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:18.016673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:18.034916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:18.036142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:18.091844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 33/58] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:18.116944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec88dc-02c8-4394-aec7-8465478e1d91 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:18.129031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec88dc-02c8-4394-aec7-8465478e1d91 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:18.133299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006972-6d71-4003-a3cd-bf8da23ee2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:18.134069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006972-6d71-4003-a3cd-bf8da23ee2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:18.134354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006972-6d71-4003-a3cd-bf8da23ee2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:18.134633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006972-6d71-4003-a3cd-bf8da23ee2a8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:18.135787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006972-6d71-4003-a3cd-bf8da23ee2a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:18.137510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006972-6d71-4003-a3cd-bf8da23ee2a8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:18.139071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 26/59] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:18.144349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:18.153466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d2f5d-73aa-419f-a482-0fe22986f1f4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:18.158673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:18.159715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:18.159715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:18.160082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:18.160808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:18.161852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:18.161852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:18.161852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:18.163087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc3749-f57f-4482-9b81-a2e0c9e2f340 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:18.276940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 34/60] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:18 2022] POST /identity/v3/users => generated 275 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:21.745902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189646b-1698-4086-9ce8-f8b341ea67a5 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.746802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189646b-1698-4086-9ce8-f8b341ea67a5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.747235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189646b-1698-4086-9ce8-f8b341ea67a5 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.749601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 27/61] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:21.754977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049b2e-d3db-4cf5-9ce2-5218ad46142c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.755784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049b2e-d3db-4cf5-9ce2-5218ad46142c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.756256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049b2e-d3db-4cf5-9ce2-5218ad46142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.781354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7c049b2e-d3db-4cf5-9ce2-5218ad46142c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:21.782813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7c049b2e-d3db-4cf5-9ce2-5218ad46142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:21.790912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 35/62] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:21.799132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2620c-cb5f-4ee7-908c-5d344913c2b1 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.799734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2620c-cb5f-4ee7-908c-5d344913c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.800272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2620c-cb5f-4ee7-908c-5d344913c2b1 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.802490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 28/63] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:21.807986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afff7-eae8-4fcd-936b-cf2b4be47e32 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.808537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afff7-eae8-4fcd-936b-cf2b4be47e32 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.809025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411afff7-eae8-4fcd-936b-cf2b4be47e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.819249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2620c-cb5f-4ee7-908c-5d344913c2b1 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:21.838573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-411afff7-eae8-4fcd-936b-cf2b4be47e32 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:21.842448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-411afff7-eae8-4fcd-936b-cf2b4be47e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:21.843742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2620c-cb5f-4ee7-908c-5d344913c2b1 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:21.850930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724efa75-b2e1-4343-acac-f14c9881544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:21.852486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724efa75-b2e1-4343-acac-f14c9881544e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.853786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724efa75-b2e1-4343-acac-f14c9881544e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.854809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724efa75-b2e1-4343-acac-f14c9881544e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.861358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 36/64] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:21.881224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77d9b1-8b5e-4226-ad32-ce87e318da56 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.881901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77d9b1-8b5e-4226-ad32-ce87e318da56 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.882369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77d9b1-8b5e-4226-ad32-ce87e318da56 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.884687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 37/65] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:21.885700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77d9b1-8b5e-4226-ad32-ce87e318da56 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:21.887334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724efa75-b2e1-4343-acac-f14c9881544e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:21.895677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-724efa75-b2e1-4343-acac-f14c9881544e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:21.897759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 29/66] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:21.899133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.899557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.900016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.905584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77d9b1-8b5e-4226-ad32-ce87e318da56 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:21.914803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:21.916441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.916950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.917574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.922744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:21.924112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:21.932757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:21.934352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 30/67] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:21.935336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:21.942737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:21.945028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 38/68] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:21.946131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d70d15-644f-40b7-b85c-d65519856ba2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:21.950433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:21.960771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:21.962243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.962779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.963277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.964419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:21.964978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:21.968092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:21.971664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc97e17-b02a-4b09-a225-f1bf1ecc4998 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:21.977427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:21.978232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:21.978517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:21.978912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 31/69] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:21.979194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:21.985297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:21.985478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:21.985478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:21.985478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:21.994404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 39/70] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:21.996076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:21.998046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19ecac-b31b-42fe-9993-668a8c024dc4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.003263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.004218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.004726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.005204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.008976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbec1f-f856-4f94-828a-12a5a1f54b21 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.017017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.017889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.018324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.018809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.019269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:22.026413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:22.028108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 32/71] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:22.029094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.043858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b6ce9-bd9f-4f26-97d5-cfe43d866ef9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.044120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.047412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.049202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.050095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 40/72] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:21 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.051112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.051675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.052208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.052679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.055642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.057907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.059723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 33/73] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.061838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.071432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a484f65-1c99-48a2-ba36-71a952f21068 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.074073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1951-7d9c-4a87-a5a1-df21ff3d37ca admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.077016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.079210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.079675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.080028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.080344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.080859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.081301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.081586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:22.081755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.082186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.084225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.090596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.092583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.099910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 41/74] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.100808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.107350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 34/75] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:22.109990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.112945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f154ee7-64a5-4b18-a001-b074edbb9f4f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.117736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.118644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.119146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.119633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.120496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0dce3f-1339-487b-ab58-aecbc374f86d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.127102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.128027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.128326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.128626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.129739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.130117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.131946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.132054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.138187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 35/76] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.139017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.145367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 42/77] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:22.151015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.151156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329cdee-f032-4974-9215-64a5c8574125 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.157214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.158613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.158913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.159201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.160797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.162543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafddcbe-dcb9-4c2d-9d9b-f0d40cfb1ee9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.162966 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.165370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 36/78] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.166294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.168121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.168998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.169482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.170245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.177765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e2ed0-d807-40ff-93b9-ed8fdc843fa3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.179264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.181316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.182705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.183556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.183862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.184196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.185407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.188952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.195913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 37/79] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.195913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.198137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 43/80] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:22.199688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.208597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b7282-bf84-4cae-9bc6-4aa9d7e07836 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.210060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca286b-15f7-4b1f-86e2-9cdd09aa4d70 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.214074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.214725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.215120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.215414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.215993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.216288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] RBAC: Adding query filter params (role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=e6052ebd33784dfbbbd7dacf4169cb3b) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:22.216610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.217284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.217679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:22.217679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:22.217679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:22.218833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.219330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.220189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.220611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=e6052ebd33784dfbbbd7dacf4169cb3b) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:22.221153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.223215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.228496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 38/81] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/role_assignments?user.id=e6052ebd33784dfbbbd7dacf4169cb3b&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.229678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.229914 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 44/82] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/role_assignments?user.id=e6052ebd33784dfbbbd7dacf4169cb3b&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.241913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1d159-745c-4102-bfe5-b9c18d677956 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.247380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b23d-62fe-4937-ab6f-bf85d46dc806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.248697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b23d-62fe-4937-ab6f-bf85d46dc806 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.250427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b23d-62fe-4937-ab6f-bf85d46dc806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.250929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b23d-62fe-4937-ab6f-bf85d46dc806 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.252621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34b23d-62fe-4937-ab6f-bf85d46dc806 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.255052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34b23d-62fe-4937-ab6f-bf85d46dc806 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.257320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 39/83] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.267393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.278782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08c379-622e-4f9c-a538-717459cc2774 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.285537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.286583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.287071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.287583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.288868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=b9a601927c06447bab4cb7cd0ec12a02) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:22.289487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.291858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab90fd-4903-4110-895b-98b050092190 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.303998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 45/84] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/role_assignments?user.id=b9a601927c06447bab4cb7cd0ec12a02&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.363077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53ad74-c272-4b5d-a50a-90c4021a7ba8 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.363371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53ad74-c272-4b5d-a50a-90c4021a7ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.363873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53ad74-c272-4b5d-a50a-90c4021a7ba8 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.366004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 40/85] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:22.372801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.373412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.373950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.395591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:22.397406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:22.412926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 46/86] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:22.465959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53ad74-c272-4b5d-a50a-90c4021a7ba8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.488264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53ad74-c272-4b5d-a50a-90c4021a7ba8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.497883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.499801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.500407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.500894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.520440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:22.527630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:22.529514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 41/87] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:22.536130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.547794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b160-8a0e-4f8b-a511-fe10d0d8b3e2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.559340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.562939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.562939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.562939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.562939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:22.562939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.564486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.580756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 47/88] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.586132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.598164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b286c-39b8-4182-b1ba-7bcb3680e122 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.607144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c95a-e959-4b82-96e3-162baa1dd2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.608894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c95a-e959-4b82-96e3-162baa1dd2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.609424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c95a-e959-4b82-96e3-162baa1dd2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.609424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c95a-e959-4b82-96e3-162baa1dd2fa admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.610680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c95a-e959-4b82-96e3-162baa1dd2fa admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.612932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c95a-e959-4b82-96e3-162baa1dd2fa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.614584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 42/89] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.620767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.637455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b957c63-4f79-423a-9691-65f14e346c4f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.646435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.647244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.647537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.647821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.659745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.663005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740e60e-8aca-431e-8449-3e5ac57e56ed None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.663300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740e60e-8aca-431e-8449-3e5ac57e56ed None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.663588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740e60e-8aca-431e-8449-3e5ac57e56ed None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.665616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 43/90] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:22.665723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.670233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.670594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.671989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.684588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 48/91] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:22.692323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.704214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:22.705448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:22.709475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188cdc-c384-41b1-b3ba-c78da9bfd643 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.719507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 44/92] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:22.728538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.729415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.729702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.729988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] PATH_INFO: `/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.731260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] RBAC: Authorizing `identity:get_project(project_id=44a9ec0cc3fd41d683ba8a01b82c8b61)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.734367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.736501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 49/93] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61 => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.742517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.748315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.758692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d14b6b-0c3e-4235-951f-494c4295a9ac None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.766920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bb55e-a1e0-4092-8281-10cc44f51775 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.769116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.769793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.770081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.770364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.771205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=44a9ec0cc3fd41d683ba8a01b82c8b61, user.id=e6052ebd33784dfbbbd7dacf4169cb3b) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:22.771611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.773727 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.782641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 45/94] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/role_assignments?user.id=e6052ebd33784dfbbbd7dacf4169cb3b&scope.project.id=44a9ec0cc3fd41d683ba8a01b82c8b61&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.788707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17119c-4a84-4893-a930-a252cc6d0d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.789549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17119c-4a84-4893-a930-a252cc6d0d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.789841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17119c-4a84-4893-a930-a252cc6d0d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.790122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17119c-4a84-4893-a930-a252cc6d0d9b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.792732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17119c-4a84-4893-a930-a252cc6d0d9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.794514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17119c-4a84-4893-a930-a252cc6d0d9b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.797209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 50/95] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:22.802793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:22.830796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af62964-8051-41ab-bcd2-c999eaa2cb8b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:22.845564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:22.846256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:22.846553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:22.846846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:22.847689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:22.848799 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:22.848799 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:22.848799 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:22.850060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd23689-bc8d-43d0-b88e-6feee2621416 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:22.959922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 46/96] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:22 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:25.130732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59962cb2-da48-4f44-a9b9-0b05314b0df8 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.131424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59962cb2-da48-4f44-a9b9-0b05314b0df8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.131424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59962cb2-da48-4f44-a9b9-0b05314b0df8 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.133058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 51/97] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:25.138377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.138888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.139038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.164877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:25.166082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:25.173965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 47/98] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:25.214232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59962cb2-da48-4f44-a9b9-0b05314b0df8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.229671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59962cb2-da48-4f44-a9b9-0b05314b0df8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.234896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.235687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.236008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.236285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.251185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:25.257965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:25.259173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 52/99] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:25.267614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.281386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f686ce4-b7c3-4153-9bd9-f7e53a28fd43 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.288497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.289175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.289460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.289741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.290589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:25.290895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.292622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e5e3a-e156-4779-90b2-44652388f267 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.302349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 48/100] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.307647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.325021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ce48-8a80-4bb1-b56f-14b752440b19 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.328591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b3b7b-6be4-4ede-a555-1bc894347020 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.328892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b3b7b-6be4-4ede-a555-1bc894347020 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.329184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b3b7b-6be4-4ede-a555-1bc894347020 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.331138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 49/101] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:25.337977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.338270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.338560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.339931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.340818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.341107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.341388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.345134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.347343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.349296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 53/102] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.357155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.370265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c45b8-0eee-457c-b7d3-2239fbf2f29f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.382073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:25.383221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:25.387585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.388475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.388794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.389080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.391604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.393729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.395481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 54/103] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.403793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.407814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 50/104] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:25.425811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b5918-6b3d-4968-b590-16897dedcd68 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.432456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.433340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.433632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.433913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/e6052ebd33784dfbbbd7dacf4169cb3b/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.441249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c05be667654943b7b35cfdc0fd4ad0, user_id=e6052ebd33784dfbbbd7dacf4169cb3b, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.442311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:25.442311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:25.442311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:25.444309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f200758-87dd-4650-8f80-7ec069ac3f1d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.448965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.458403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0a4b5-cb72-46fc-98d2-71d298f3f67b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.473113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b6a0-534c-424a-8f6c-ee83a5798781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.479443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b6a0-534c-424a-8f6c-ee83a5798781 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.479443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b6a0-534c-424a-8f6c-ee83a5798781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.479443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b6a0-534c-424a-8f6c-ee83a5798781 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.496763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02b6a0-534c-424a-8f6c-ee83a5798781 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:25.504156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4a02b6a0-534c-424a-8f6c-ee83a5798781 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:25.505721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 51/105] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:25.511692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362dc29-9708-47c1-b3d3-f58899a6ec8a None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.512185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362dc29-9708-47c1-b3d3-f58899a6ec8a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.512690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362dc29-9708-47c1-b3d3-f58899a6ec8a None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.514594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 52/106] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:25.515456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362dc29-9708-47c1-b3d3-f58899a6ec8a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.534931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362dc29-9708-47c1-b3d3-f58899a6ec8a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.538707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 55/107] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:25 2022] PUT /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/e6052ebd33784dfbbbd7dacf4169cb3b/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:25.540252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420bc9b-e3d4-41a8-9937-bd2370409ba5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.540844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420bc9b-e3d4-41a8-9937-bd2370409ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.541316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420bc9b-e3d4-41a8-9937-bd2370409ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.571129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b420bc9b-e3d4-41a8-9937-bd2370409ba5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:25.574176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b420bc9b-e3d4-41a8-9937-bd2370409ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:25.653946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.654563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.655367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.655657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.656477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:25.656790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.658492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.677754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 56/108] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:25.680902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64deab3-5ec0-404c-8499-31c6ac61b6b2 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.681366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 53/109] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.681902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64deab3-5ec0-404c-8499-31c6ac61b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.686774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64deab3-5ec0-404c-8499-31c6ac61b6b2 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.688213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.696086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 57/110] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:25.699556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.700151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.700634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.707809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01f7ac-489a-43eb-aeca-3546fd9b538a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.725482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.730105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.730105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.730105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.730105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.733663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.737629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 54/111] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.738861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:25.739872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.741280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:25.753677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4a5eb-6dbb-43be-b5b4-736eaae5f7a8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.762242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.763115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.763421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.763708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.765505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 58/112] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:25.766389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.782271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d27c1-7560-4c74-9d82-de98e121f33e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.784811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:25.788093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.788964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.793262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.793262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.793262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.793262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.793539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:25.794714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 59/114] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.800317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 55/114] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:25.801323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.801422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.812656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed111166-dcb7-440b-a4b1-a00a356923d9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.817288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c06fd-7657-405a-8a99-2e9f903929ca admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.817495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.818455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.818773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.819105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/e6052ebd33784dfbbbd7dacf4169cb3b/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.821389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c05be667654943b7b35cfdc0fd4ad0, user_id=e6052ebd33784dfbbbd7dacf4169cb3b, role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.824117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.824323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.824927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.825272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.825555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.826581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:25.827332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.829037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.841882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 56/115] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.843347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.853344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee5e8-5685-4d68-b415-c3fca46c484f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.858091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.859182 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.859474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.859757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.870528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:25.877736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:25.879048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 57/116] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:25.879731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.890255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eb070-d1ce-48a2-8e8d-5b5206ec6187 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.895056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.895921 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.896213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.896496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.897700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.900053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.901679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 58/117] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.902433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.913931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75880-10a6-4052-9c42-a0ecf6c608ed admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.919486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.920222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.921114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.921497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.922329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:25.922702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.924465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.933678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 59/118] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.934326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.945105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4aa98d-2aa9-46e7-b7bc-6ce2ecb60568 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.950012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.950907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.951196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.951570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] PATH_INFO: `/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.953837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] RBAC: Authorizing `identity:get_project(project_id=44a9ec0cc3fd41d683ba8a01b82c8b61)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.956102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.957933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 60/119] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.958734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.970224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba53a29-3c5b-4e65-b53b-268bf8606608 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:25.975220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:25.976151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:25.976446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:25.976730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:25.977989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:25.980131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:25.981915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 61/120] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:25 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:25.982726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:25.993323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f806-c0d0-45fb-a483-3256b12b77d4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:26.003394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 60/121] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:25 2022] PUT /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/e6052ebd33784dfbbbd7dacf4169cb3b/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:26.004168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:26.006023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:26.006926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:26.007216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:26.007550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] PATH_INFO: `/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61/users/e6052ebd33784dfbbbd7dacf4169cb3b/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:26.013688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a9ec0cc3fd41d683ba8a01b82c8b61, user_id=e6052ebd33784dfbbbd7dacf4169cb3b, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:26.015058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:26.094849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9181d-2298-4e2c-98d9-b9a2fa1699d7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:26.106143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 62/122] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:25 2022] PUT /identity/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61/users/e6052ebd33784dfbbbd7dacf4169cb3b/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:26.112856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e7f4a-c32b-4ace-a95d-0452710c8f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:26.113815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e7f4a-c32b-4ace-a95d-0452710c8f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:26.114152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e7f4a-c32b-4ace-a95d-0452710c8f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:26.114444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e7f4a-c32b-4ace-a95d-0452710c8f56 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:26.115789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e7f4a-c32b-4ace-a95d-0452710c8f56 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:26.118138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e7f4a-c32b-4ace-a95d-0452710c8f56 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:26.120436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 61/123] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:26 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:26.127064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:26.200568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372b610-7654-4154-91e1-e253627e2e07 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:26.205659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a410e24-363c-412b-a0ae-3a391de7ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:26.206583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410e24-363c-412b-a0ae-3a391de7ae56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:26.206873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410e24-363c-412b-a0ae-3a391de7ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:26.207154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410e24-363c-412b-a0ae-3a391de7ae56 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/b9a601927c06447bab4cb7cd0ec12a02/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:26.209349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a410e24-363c-412b-a0ae-3a391de7ae56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c05be667654943b7b35cfdc0fd4ad0, user_id=b9a601927c06447bab4cb7cd0ec12a02, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:26.212450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a410e24-363c-412b-a0ae-3a391de7ae56 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:26.284635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 63/124] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:26 2022] PUT /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/b9a601927c06447bab4cb7cd0ec12a02/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:27.223163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8ef2-cc8e-4c74-9960-ed45a2ab18ba None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.223883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8ef2-cc8e-4c74-9960-ed45a2ab18ba None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.223883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e8ef2-cc8e-4c74-9960-ed45a2ab18ba None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.225806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 62/125] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:27.230779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.231247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.231395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.256886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:27.258107 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:27.341442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 64/126] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:27.369640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7218e0a-b518-410c-b49a-d3731c83b74a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.369940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7218e0a-b518-410c-b49a-d3731c83b74a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.370234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7218e0a-b518-410c-b49a-d3731c83b74a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.372074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 63/127] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:27.382597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.386727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.387028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.387313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.410578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6dac3-7fa6-476b-b3c6-0d9c00dde527 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.420011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:27.421857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:27.430219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.431135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.431433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.431719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.440201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 64/128] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:27.453120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:27.460142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:27.461628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 65/129] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:27.467507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.476161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.481375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80597e-0e33-4ee2-9a96-b0c503e816e0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.492026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b9418-b944-49b8-ac6c-0353a842b597 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.493269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.493950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.494235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.494516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.495287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:27.495596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.499695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.504479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.505276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.505563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.505841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.509629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.512051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.517297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 66/130] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:27.517538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 65/131] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:27.523489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.527210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.542672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929653d7-4647-4579-a3e1-bbb32e4bcd02 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.547072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49639ef9-0883-4710-80ce-ab08bbe3e8a9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.555645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.556557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.556846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.557128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] PATH_INFO: `/v3/users/495d6a4ffc0742208747f7c08ae5cca6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.558148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.558804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.559083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.559357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.560112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.565615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.585357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=495d6a4ffc0742208747f7c08ae5cca6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.587804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.589723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 66/132] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/users/495d6a4ffc0742208747f7c08ae5cca6 => generated 289 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:27.600845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.611804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376db3b3-6bfc-480d-8bdd-a7b30802daf0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.618356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.619108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.619439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.619734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.632233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.634166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.649940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 67/133] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:27.655735 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.673884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 67/134] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:49:27 2022] POST /identity/v3/projects => generated 302 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:27.674545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895de69-45bd-448a-aa5f-fc6fb49d5bcb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.750285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de710303-ffeb-4590-bbe0-710300484bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.751325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de710303-ffeb-4590-bbe0-710300484bdf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.751619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de710303-ffeb-4590-bbe0-710300484bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.751927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de710303-ffeb-4590-bbe0-710300484bdf admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.753199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de710303-ffeb-4590-bbe0-710300484bdf admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.755350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de710303-ffeb-4590-bbe0-710300484bdf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.757516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 68/135] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:27.763544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:27.776003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c952a2-5f1f-40c5-ab65-bb669f0a2c4f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:27.781874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:27.782601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:27.782893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:27.783179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:27.784161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] RBAC: Adding query filter params (role.id=10af6e232dab44c8ad6d3d3dfbba17a6, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=495d6a4ffc0742208747f7c08ae5cca6) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:27.784476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:27.786522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc04a1-781f-4277-8013-b5d05b041fd2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:27.797505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 68/136] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:27 2022] GET /identity/v3/role_assignments?user.id=495d6a4ffc0742208747f7c08ae5cca6&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=10af6e232dab44c8ad6d3d3dfbba17a6 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:28.767576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293afb4-8312-4540-9703-cce25259e0ad None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:28.768319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293afb4-8312-4540-9703-cce25259e0ad None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:28.768319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293afb4-8312-4540-9703-cce25259e0ad None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:28.770190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 69/137] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:28.775715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:28.776241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:28.776416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:28.801606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:28.802811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:28.815872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 69/138] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:28.852177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293afb4-8312-4540-9703-cce25259e0ad None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:28.870087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293afb4-8312-4540-9703-cce25259e0ad None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:28.877351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:28.878156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:28.878445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:28.878728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:28.896046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:28.903040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:28.904302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 70/139] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:28.910295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:28.919632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f4d0f-a868-473a-bb37-86bd6f11d5bc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:28.927533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:28.928248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:28.928536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:28.928815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:28.929574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:28.929891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:28.931523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:28.944760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 70/140] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:28.950282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:28.966690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33269faa-5096-4554-92d8-e3beddc81b95 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:28.972960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:28.973944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:28.974197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:28.974479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:28.975787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:28.978379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:28.980535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 71/141] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:28 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:28.986689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:28.999474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed52f06-21a4-4814-bf85-ced9db653689 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.005419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.006575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.006873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.007156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.019171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.020977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.033633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 71/142] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:29.039503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.050948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633670f-44ed-4e8c-bde1-627aa17e0445 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.062046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650d2fd-7966-4c93-8bbe-c01b4f4687b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.062929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d2fd-7966-4c93-8bbe-c01b4f4687b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.063214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d2fd-7966-4c93-8bbe-c01b4f4687b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.063495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d2fd-7966-4c93-8bbe-c01b4f4687b7 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.064786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650d2fd-7966-4c93-8bbe-c01b4f4687b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.067158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650d2fd-7966-4c93-8bbe-c01b4f4687b7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.069077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 72/143] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:29.075032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.085545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755d15a-1aa3-47ca-a4eb-f710c993525c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.095075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.095779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.096098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.096430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.097319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=e6052ebd33784dfbbbd7dacf4169cb3b) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:29.097692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.099668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2228c-a160-4cb1-a227-90cc7f1f6ec3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.109670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 72/144] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/role_assignments?user.id=e6052ebd33784dfbbbd7dacf4169cb3b&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:29.526380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa7fb-55b0-43b0-8c0d-45e8fedc3ab7 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.526738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa7fb-55b0-43b0-8c0d-45e8fedc3ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.526949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa7fb-55b0-43b0-8c0d-45e8fedc3ab7 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.529157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917706c-4c80-4702-a645-444507c6e34f None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.529157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917706c-4c80-4702-a645-444507c6e34f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.529348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 73/145] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:29.530259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917706c-4c80-4702-a645-444507c6e34f None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.532220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 73/146] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:29.537606 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.537951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.538241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.538633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.539141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.539735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.560682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:29.562505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:29.564183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:29.565568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:29.579712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 74/147] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:29.582645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 74/148] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:29.607998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.613035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.626388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe14a7-6207-4769-8d2e-3c4b8dbf6d49 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.628484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ee190-e3ed-417e-936c-03bc1a4f585f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.637296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.638163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.639737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.640798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.641247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.641667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.642142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.643205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.664879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:29.667901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:29.676924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:29.681276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 75/149] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:29.681462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:29.682836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 75/150] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:29.687484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.688808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.698482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115bb48-e942-4134-9c28-018573a75dd0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.703553 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fd907-2076-449c-b4a5-94535651a01e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.703743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.704683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.705166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.705596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.706544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:29.707158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.709138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.718126 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.718804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.719093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.719373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.720168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:29.720494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.721157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 76/151] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:29.723876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.733620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.738387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f3a65-cf20-4096-a354-15ce2722f81d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.739006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 76/152] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:29.743560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.744733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.744874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.745291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.745803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.747228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.750526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.752470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 77/153] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:29.760052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.761648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2ca7-525f-4257-910b-ce29b3c61387 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.772953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.773830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.774112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.774388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] PATH_INFO: `/v3/users/b9a601927c06447bab4cb7cd0ec12a02` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.775616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] RBAC: Authorizing `identity:get_user(user_id=b9a601927c06447bab4cb7cd0ec12a02)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.776522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da23f-9bc3-4a3b-8260-9fbb0afc7b26 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.777471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.780659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 77/154] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/users/b9a601927c06447bab4cb7cd0ec12a02 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:29.787283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.788192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.789237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.789898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.790328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.800651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.802722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.806215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12ac58-9b88-4be1-83e6-14706d7c43ef admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.814733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 78/155] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:49:29.820399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.820525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.821104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.821393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.821669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.833164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524a421-7721-49b3-92e1-9debe9756583 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.838071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.838636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.839694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.839828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.840352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.840849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.845463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.847928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.855199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 78/157] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:29.855385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 79/156] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:29.860878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.866607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.877704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c583b-9de0-4624-8943-c6b08afed512 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.888299 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.892145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.892627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.893088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.893557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd52c3c-bac4-4a68-8832-95b5a5097016 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.894645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] RBAC: Adding query filter params (role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=e6052ebd33784dfbbbd7dacf4169cb3b) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:29.896273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.900811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.903146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c0025-377d-4271-ad12-5ae26489df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.905866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0025-377d-4271-ad12-5ae26489df68 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.906346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0025-377d-4271-ad12-5ae26489df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.907328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c0025-377d-4271-ad12-5ae26489df68 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.909470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c0025-377d-4271-ad12-5ae26489df68 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.912910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c0025-377d-4271-ad12-5ae26489df68 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.915804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 79/158] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/role_assignments?user.id=e6052ebd33784dfbbbd7dacf4169cb3b&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:29.922054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 80/159] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:29.928285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:29.942289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eff65-2e09-49f5-b9bf-5561d30b3b1a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:29.948449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:29.949600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:29.950135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:29.950657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:29.952511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=b9a601927c06447bab4cb7cd0ec12a02) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:29.953042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:29.955461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884b990-443d-4eba-83bc-ed10a8d4454e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:29.967762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 80/160] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:29 2022] GET /identity/v3/role_assignments?user.id=b9a601927c06447bab4cb7cd0ec12a02&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:30.338593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c37828-e1ba-43aa-b213-503affb01484 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.339173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c37828-e1ba-43aa-b213-503affb01484 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.339658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c37828-e1ba-43aa-b213-503affb01484 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.341820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 81/161] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:30.348331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.348904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.349365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.372074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:30.374212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:30.385201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 81/162] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:30.410456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c37828-e1ba-43aa-b213-503affb01484 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:30.423927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c37828-e1ba-43aa-b213-503affb01484 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:30.428244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:30.429026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.429310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.429584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.441110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:30.447979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:30.449408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 82/163] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:30.455558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:30.464945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bee89-fc5f-495e-8d6a-aeefd36e2e02 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:30.469642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:30.470179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.470463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.470740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.471576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:30.471917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:30.473530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:30.482114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 82/164] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:30.487428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:30.497766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b36c1c-da1a-4630-874b-d92cdc84726b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:30.502925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:30.503783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.504106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.504377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] PATH_INFO: `/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.505578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] RBAC: Authorizing `identity:get_user(user_id=e6052ebd33784dfbbbd7dacf4169cb3b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:30.507724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:30.509566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 83/165] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:30 2022] GET /identity/v3/users/e6052ebd33784dfbbbd7dacf4169cb3b => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:30.515267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:30.524927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd52da0-97ad-4f37-bcac-c6fe82c0526c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:30.529302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:30.530014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.530300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.530576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.538480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:30.540276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:30.549167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 83/166] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:30.554435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:30.564961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a3ff-7e1d-4c39-91d6-f7f5d52682ec admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:30.569299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15b215-6904-47f6-a5a8-a2bb97d02127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:30.570144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b215-6904-47f6-a5a8-a2bb97d02127 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.570427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b215-6904-47f6-a5a8-a2bb97d02127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.570703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b215-6904-47f6-a5a8-a2bb97d02127 admin admin] PATH_INFO: `/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.571896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15b215-6904-47f6-a5a8-a2bb97d02127 admin admin] RBAC: Authorizing `identity:get_project(project_id=44a9ec0cc3fd41d683ba8a01b82c8b61)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:30.573950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15b215-6904-47f6-a5a8-a2bb97d02127 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:30.575790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 84/167] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:30 2022] GET /identity/v3/projects/44a9ec0cc3fd41d683ba8a01b82c8b61 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:30.582104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:30.592786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1cbe7-6812-4d6e-8e63-3167c15a0d72 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:30.597529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:30.598201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.598484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.598759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.599605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=44a9ec0cc3fd41d683ba8a01b82c8b61, user.id=e6052ebd33784dfbbbd7dacf4169cb3b) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:30.599955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:30.601887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339f83e-3209-4333-b058-a17d0d98fb2b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:30.609537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 84/168] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:30 2022] GET /identity/v3/role_assignments?user.id=e6052ebd33784dfbbbd7dacf4169cb3b&scope.project.id=44a9ec0cc3fd41d683ba8a01b82c8b61&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:30.957020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b401-3b5f-4ba2-a064-f76357b8dc43 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.957510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b401-3b5f-4ba2-a064-f76357b8dc43 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.957510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b401-3b5f-4ba2-a064-f76357b8dc43 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.959366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 85/169] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:30.964877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:30.965300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:30.965485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:30.983389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:30.984677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:30.992248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 85/170] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:31.014785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b401-3b5f-4ba2-a064-f76357b8dc43 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.026684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b401-3b5f-4ba2-a064-f76357b8dc43 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.030972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.031744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.032050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.032320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.042303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:31.049569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:31.050742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 86/171] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:31.056605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.066683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f6adc-4f4f-41f3-aba6-a7bbbfc4327b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.071192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.071881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.072169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.072446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.073267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:31.073574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:31.075180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:31.084166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 86/172] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:31.090128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.100281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc091f-ea2c-422e-aefd-f0adcfbd3933 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.104695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.105569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.105852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.106128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] PATH_INFO: `/v3/users/495d6a4ffc0742208747f7c08ae5cca6` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.107306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] RBAC: Authorizing `identity:get_user(user_id=495d6a4ffc0742208747f7c08ae5cca6)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:31.110128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:31.111693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 87/173] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:31 2022] GET /identity/v3/users/495d6a4ffc0742208747f7c08ae5cca6 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:31.117123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.127218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7e6ac-8b7e-4e1d-8df0-513b41347c12 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.131542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddbc20-8c73-40b9-9cd9-96ba536d0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.132411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbc20-8c73-40b9-9cd9-96ba536d0b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.132701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbc20-8c73-40b9-9cd9-96ba536d0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.132981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddbc20-8c73-40b9-9cd9-96ba536d0b8b admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.134184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddbc20-8c73-40b9-9cd9-96ba536d0b8b admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:31.136293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddbc20-8c73-40b9-9cd9-96ba536d0b8b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:31.137953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 87/174] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:31 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:31.143621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.153751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063ae55-2e81-4a9e-b5b9-c4eff0e4752c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.158659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.159512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.159791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.160093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/495d6a4ffc0742208747f7c08ae5cca6/roles/10af6e232dab44c8ad6d3d3dfbba17a6` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.162028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c05be667654943b7b35cfdc0fd4ad0, user_id=495d6a4ffc0742208747f7c08ae5cca6, role_id=10af6e232dab44c8ad6d3d3dfbba17a6)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:31.164682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:31.182349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181a88-d699-4b30-8dc7-48bfc539b371 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.182673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181a88-d699-4b30-8dc7-48bfc539b371 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.185156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181a88-d699-4b30-8dc7-48bfc539b371 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.185156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 88/175] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:31.189901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.190201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.190483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.208332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:31.209455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:31.217950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 89/176] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:31.242220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 88/177] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:31 2022] PUT /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/users/495d6a4ffc0742208747f7c08ae5cca6/roles/10af6e232dab44c8ad6d3d3dfbba17a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:49:31.243037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.253038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861e935-dcab-46b9-ba11-f7cbb6bb724f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.312960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516e4b1-72ad-450b-a1f0-f638b8275e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.313760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e4b1-72ad-450b-a1f0-f638b8275e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.314039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e4b1-72ad-450b-a1f0-f638b8275e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.314312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516e4b1-72ad-450b-a1f0-f638b8275e72 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.315504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e4b1-72ad-450b-a1f0-f638b8275e72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:31.317308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516e4b1-72ad-450b-a1f0-f638b8275e72 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:31.318992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 90/178] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:31.324774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:31.335863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ef32-8ddb-49d4-b8f9-8f3ca1789684 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:31.340797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cab29-e1cd-460a-a7ab-e4b239ff2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:31.341571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cab29-e1cd-460a-a7ab-e4b239ff2665 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:31.342493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cab29-e1cd-460a-a7ab-e4b239ff2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:31.343119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cab29-e1cd-460a-a7ab-e4b239ff2665 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:31.344022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cab29-e1cd-460a-a7ab-e4b239ff2665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:31.346069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cab29-e1cd-460a-a7ab-e4b239ff2665 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:31.459753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 89/179] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:31 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:33.564783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511650-d8e9-4b45-b612-dae0c6f4a00a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.565818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511650-d8e9-4b45-b612-dae0c6f4a00a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.566307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d511650-d8e9-4b45-b612-dae0c6f4a00a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.568482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 91/180] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:33.574992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.575508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.575580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.596224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:33.597442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:33.605420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 90/181] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:33.630189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511650-d8e9-4b45-b612-dae0c6f4a00a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:33.642626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d511650-d8e9-4b45-b612-dae0c6f4a00a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:33.646987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:33.647777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.648097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.648380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.659796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:33.666834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:33.668290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 92/182] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:33.674846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:33.684341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3a2a3-6554-46d2-a619-543809ea59fb None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:33.689170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:33.689859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.690144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.690422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.691188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:33.691495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:33.693198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:33.708185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 91/183] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:33.713738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:33.724357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4728a1-4034-453e-9b00-96688d970dab admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:33.728977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:33.729870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.730151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.730434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] PATH_INFO: `/v3/users/495d6a4ffc0742208747f7c08ae5cca6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.731738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] RBAC: Authorizing `identity:get_user(user_id=495d6a4ffc0742208747f7c08ae5cca6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:33.734373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:33.736523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 93/184] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:33 2022] GET /identity/v3/users/495d6a4ffc0742208747f7c08ae5cca6 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:33.742256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:33.753473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be08c6-3746-4bdf-9531-6f6f757ef969 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:33.758371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:33.759124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.759477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.759823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.769123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:33.770961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:33.781573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 92/185] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:33.787418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:33.798882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5035e-4e71-4f8f-966a-6fe2047d8406 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:33.803684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c8142-dd88-4896-a54e-d772993b04d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:33.804781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c8142-dd88-4896-a54e-d772993b04d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.805261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c8142-dd88-4896-a54e-d772993b04d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.805732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c8142-dd88-4896-a54e-d772993b04d8 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.807267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c8142-dd88-4896-a54e-d772993b04d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:33.809560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c8142-dd88-4896-a54e-d772993b04d8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:33.812308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 94/186] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:33 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:33.818494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:33.827809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb749c-d83f-4f27-833c-4fb0c840f15a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:33.832529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:33.833233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.833582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.833922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.834817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] RBAC: Adding query filter params (role.id=10af6e232dab44c8ad6d3d3dfbba17a6, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0, user.id=495d6a4ffc0742208747f7c08ae5cca6) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:33.835193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:33.837483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d85e5-3ae8-4cd7-8411-891b12fdc317 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:33.844509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 93/187] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:33 2022] GET /identity/v3/role_assignments?user.id=495d6a4ffc0742208747f7c08ae5cca6&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=10af6e232dab44c8ad6d3d3dfbba17a6 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:33.957490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612b22-041b-4663-a2f5-3a82c794bf6d None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.957789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612b22-041b-4663-a2f5-3a82c794bf6d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.957974 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad612b22-041b-4663-a2f5-3a82c794bf6d None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.959780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 95/188] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:33.965901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:33.966197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:33.966464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:33.986733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:33.987969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:33.996160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 94/189] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:34.021934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad612b22-041b-4663-a2f5-3a82c794bf6d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.034658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad612b22-041b-4663-a2f5-3a82c794bf6d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.039154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d278a-ca97-4f09-be06-5b5914b5e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.039980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d278a-ca97-4f09-be06-5b5914b5e3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.040262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d278a-ca97-4f09-be06-5b5914b5e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.040534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d278a-ca97-4f09-be06-5b5914b5e3b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.052939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d278a-ca97-4f09-be06-5b5914b5e3b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:34.060197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-879d278a-ca97-4f09-be06-5b5914b5e3b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:34.062294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 96/190] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:34.068093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.079169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511887d7-3872-41f6-8062-f08682cbf119 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.087495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.088604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.089115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.089624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.090428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:34.090705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.093176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.099656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cad4c-2706-4ecf-aed2-e3e682635108 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.099983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cad4c-2706-4ecf-aed2-e3e682635108 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.100267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cad4c-2706-4ecf-aed2-e3e682635108 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.102190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 97/191] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:34.102977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 95/192] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:34.107348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01957e8d-ab90-44d4-a0e0-9961bfb714c6 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.107673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01957e8d-ab90-44d4-a0e0-9961bfb714c6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.107990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01957e8d-ab90-44d4-a0e0-9961bfb714c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.108984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.119058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9ab43-aebc-49de-93f6-2fac777baf31 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.125805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.126682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.126967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.127245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] PATH_INFO: `/v3/users/33b455f4fe63416a83b4c6a76d494e4f` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.128320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-01957e8d-ab90-44d4-a0e0-9961bfb714c6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:34.129760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-01957e8d-ab90-44d4-a0e0-9961bfb714c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:34.138368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 98/193] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:34.140266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6605-bc69-4725-a6b4-575159dcbca1 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.140561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6605-bc69-4725-a6b4-575159dcbca1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.140828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6605-bc69-4725-a6b4-575159dcbca1 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.144356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=33b455f4fe63416a83b4c6a76d494e4f)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.146657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.146825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 99/194] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:34.148037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.148332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.148497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 96/195] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/users/33b455f4fe63416a83b4c6a76d494e4f => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:34.148864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.153646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.163300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a1ca4-40fb-4a52-bac2-beb4e27f92f1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.166971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:34.167656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.168194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:34.168315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.168597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.168871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.176086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 100/196] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:34.176884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.176994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.178768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.187110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f155b-ed5e-4bf3-a6ba-583e2ffac396 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.188302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 97/197] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:49:34.191650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.192458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.192898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.193016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.193677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.194163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.195871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.197604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 101/198] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:34.200711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.203057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67694be-633e-471a-8f9f-396fe5a469e1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.207408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.208307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.208590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.208802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.209963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.211464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81893d5f-0a24-46ab-a464-4e36b3dade9c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.212291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.213923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 98/199] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:34.215876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.216007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.216651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.217165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.217467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.225505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ed35e-97bd-4bb4-93a1-faeafdcd15ca admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.227947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:34.229881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462fe41-dd91-4ac2-ba7d-3411720a5b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.230484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462fe41-dd91-4ac2-ba7d-3411720a5b12 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.230765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462fe41-dd91-4ac2-ba7d-3411720a5b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.231064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462fe41-dd91-4ac2-ba7d-3411720a5b12 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.231726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462fe41-dd91-4ac2-ba7d-3411720a5b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.233699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462fe41-dd91-4ac2-ba7d-3411720a5b12 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.235240 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:34.236453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 102/200] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:34.238285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.249417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30d20f-f19b-490a-85d6-5b08b7c31370 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.253794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.254404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.259024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.259024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.259024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=33b455f4fe63416a83b4c6a76d494e4f) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:34.259024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.259024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.263341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 103/201] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/role_assignments?user.id=33b455f4fe63416a83b4c6a76d494e4f&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:34.264865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.274614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353992-7f04-49e9-bb2f-e12466c75d86 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.279388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.280113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.280502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.280787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.281601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:34.281905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.283580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.293051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 104/202] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:34.299256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.309880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230a54-0974-4733-8b26-4e6ca35ec9f9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.315469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.316403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.316688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.316971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] PATH_INFO: `/v3/users/33b455f4fe63416a83b4c6a76d494e4f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.318258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=33b455f4fe63416a83b4c6a76d494e4f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.320496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.322227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 105/203] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/users/33b455f4fe63416a83b4c6a76d494e4f => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:34.328828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.339391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65220b-304f-49af-a646-892d11eb86b5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.345200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.351184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.351184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.351184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.356051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.358471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.368380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 106/204] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:34.374073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.383266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcc5f2-a8a6-4472-8f70-8a1b92d3f396 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.387763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.388689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.388969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.389327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.390541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.392674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.394583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 107/205] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:34.397031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 99/206] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:34 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:34.400818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:34.413495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad23e48-7394-414b-a98b-d8b798300f09 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:34.418198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:34.418876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:34.425217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:34.425217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:34.425217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] RBAC: Adding query filter params (role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=33b455f4fe63416a83b4c6a76d494e4f) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:34.425217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:34.425217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dce48f-ca01-4c3d-8a19-01f55d155196 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:34.431722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 108/207] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:34 2022] GET /identity/v3/role_assignments?user.id=33b455f4fe63416a83b4c6a76d494e4f&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:36.608670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf9af-a8a0-4deb-9712-c3aacb53daee None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.608670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf9af-a8a0-4deb-9712-c3aacb53daee None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.608670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bf9af-a8a0-4deb-9712-c3aacb53daee None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.610111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 100/208] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:36.615742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.616601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.617105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.636377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:36.638001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:36.646490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 109/209] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:36.672136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf9af-a8a0-4deb-9712-c3aacb53daee None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:36.684800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bf9af-a8a0-4deb-9712-c3aacb53daee None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:36.689998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:36.690780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.691065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.691348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.703533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:36.710603 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:36.712258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 101/210] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:36.719825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:36.729084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791683-8f77-4cd1-ad4d-c19291eab937 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:36.735105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:36.735771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.736178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.736469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.737235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:36.737544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:36.739286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:36.748155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 110/211] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:36.754550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:36.767049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0e1a6-4619-4be5-aee6-65e185d9f374 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:36.771738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:36.772731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.773019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.773304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] PATH_INFO: `/v3/users/33b455f4fe63416a83b4c6a76d494e4f` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.774535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=33b455f4fe63416a83b4c6a76d494e4f)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:36.776712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:36.778561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 102/212] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:36 2022] GET /identity/v3/users/33b455f4fe63416a83b4c6a76d494e4f => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:36.784772 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:36.794476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593b0d1-d407-4c0f-bf0f-ef0f863e353a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:36.799920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c644c6-1117-49e9-ac57-98cae5405944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:36.800763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c644c6-1117-49e9-ac57-98cae5405944 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.801150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c644c6-1117-49e9-ac57-98cae5405944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.801438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c644c6-1117-49e9-ac57-98cae5405944 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.802628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c644c6-1117-49e9-ac57-98cae5405944 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:36.804833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c644c6-1117-49e9-ac57-98cae5405944 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:36.806584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 111/213] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:36 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:36.813060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:36.818461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f2fa9-44ef-410b-89a3-fdf8caa65ef6 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.818753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f2fa9-44ef-410b-89a3-fdf8caa65ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.819035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f2fa9-44ef-410b-89a3-fdf8caa65ef6 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.820829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 112/214] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:36.825430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9ed8-1fbe-4903-b192-5d7c38c108f9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:36.825979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184e8c-baef-41d8-a053-7cf455d3a921 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.826316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184e8c-baef-41d8-a053-7cf455d3a921 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.826639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184e8c-baef-41d8-a053-7cf455d3a921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.831184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:36.832406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.832887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.833376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/33b455f4fe63416a83b4c6a76d494e4f/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.836403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=497116fb453d468cb1d97b32fa046dfa, user_id=33b455f4fe63416a83b4c6a76d494e4f, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:36.839113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:36.906021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-79184e8c-baef-41d8-a053-7cf455d3a921 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:36.907143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-79184e8c-baef-41d8-a053-7cf455d3a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:36.914871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 113/215] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:36.916306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41e3-9d4a-4eb0-bd79-8382ed564b0f None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.916596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41e3-9d4a-4eb0-bd79-8382ed564b0f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.916875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41e3-9d4a-4eb0-bd79-8382ed564b0f None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.918786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 114/216] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:36.924707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670670-8e2b-4e6f-9179-c152daacb18b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:36.925006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670670-8e2b-4e6f-9179-c152daacb18b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:36.925290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7670670-8e2b-4e6f-9179-c152daacb18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:36.944563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c7670670-8e2b-4e6f-9179-c152daacb18b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:36.944848 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 103/217] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:36 2022] PUT /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/33b455f4fe63416a83b4c6a76d494e4f/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:36.945697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:36.945835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c7670670-8e2b-4e6f-9179-c152daacb18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:37.093410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 115/218] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:37.095172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeea4d-08cd-4cf9-a3f3-0b521fdda22c None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.095468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeea4d-08cd-4cf9-a3f3-0b521fdda22c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.095745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeea4d-08cd-4cf9-a3f3-0b521fdda22c None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.097732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 116/219] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:37.103421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.103710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.104046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.105365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b039b4d-8c3c-4ab7-8b24-fce4a8cfbe3c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.111024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.113109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.113646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.114141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.126844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:37.128081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:37.133665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:37.136510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 117/220] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:37.137408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.143736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:37.145040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 104/221] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:37.147814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53b1df-7845-4493-9602-8a01848c224d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.151293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.153365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.154559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.155022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.155437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.162635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b3491-c74a-4d95-8185-551294b2ecd3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.167161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.167823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.168139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.168410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.169072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:37.169188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:37.169472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.171941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.176965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:37.178242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 118/222] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:37.179005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.181939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 105/223] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.184813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.190887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d77ce-2673-4111-a3a1-b5ccaaf2484e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.195427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.195591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70525978-15c0-4a99-9071-23c1fac1721a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.196238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.196526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.196802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.197982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.199998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.200144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.200667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.200954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.201928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.202738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 119/224] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.202904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:37.203127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.204768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.205528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.214352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 106/225] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.215149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.221658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669be87-a81a-4621-ab9a-4880e38a7b2f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.225291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d7e07-86b5-4408-990f-ef192eb90e4a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.226168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.227121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.227438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.227845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] PATH_INFO: `/v3/users/33b455f4fe63416a83b4c6a76d494e4f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.229061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] RBAC: Authorizing `identity:get_user(user_id=33b455f4fe63416a83b4c6a76d494e4f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.230020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.230748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.231108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.231286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.231526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.232405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.233244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 120/226] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/users/33b455f4fe63416a83b4c6a76d494e4f => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.234483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.236603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.250439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c8e10-8608-488b-8c36-cf277f06b171 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.254812 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.255676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.255981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.256262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] PATH_INFO: `/v3/users/3e5c213fbf524a25b081280ff44498eb` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.270483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e5c213fbf524a25b081280ff44498eb)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.272659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.274307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 121/227] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/users/3e5c213fbf524a25b081280ff44498eb => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.276243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.285755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee1ce0-aa59-4559-a5bb-55d98f3616d9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.290286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.292835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.292835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.292835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.293072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.295191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.297002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 122/228] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.301687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.307088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2705e-1db4-46d3-a745-dec2f39ac8c4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.312279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.312889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.313175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.313476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.322252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 107/229] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:37 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:37.323058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.333249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.335071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.336403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151609bd-756a-4c0c-8cff-50c10093b451 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.341930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29534892-e84f-45ef-a752-4f8a6a50a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.343251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29534892-e84f-45ef-a752-4f8a6a50a7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.344910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29534892-e84f-45ef-a752-4f8a6a50a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.344910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29534892-e84f-45ef-a752-4f8a6a50a7dc admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/33b455f4fe63416a83b4c6a76d494e4f/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.346397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 123/230] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:37.348962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29534892-e84f-45ef-a752-4f8a6a50a7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=497116fb453d468cb1d97b32fa046dfa, user_id=33b455f4fe63416a83b4c6a76d494e4f, role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.352124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.352430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29534892-e84f-45ef-a752-4f8a6a50a7dc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.369872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d1bc8-f870-42d1-8241-6499dabefcb8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.375872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.376794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.377082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.377395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.378823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.381098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.384903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 124/231] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:37.390104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:37.400748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd372e-d755-41d1-81a5-464630df4084 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:37.408782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:37.409656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:37.410097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:37.410475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:37.411461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=3e5c213fbf524a25b081280ff44498eb) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:37.411783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:37.417784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13acf0-683c-4f0f-a69b-11d5ffe965b4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:37.428145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 125/232] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:37 2022] GET /identity/v3/role_assignments?user.id=3e5c213fbf524a25b081280ff44498eb&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:37.444318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 108/233] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:37 2022] PUT /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/33b455f4fe63416a83b4c6a76d494e4f/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:39.664538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9623ff-2670-40ba-aa8e-0459f28216ea None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:39.665058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9623ff-2670-40ba-aa8e-0459f28216ea None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:39.665058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9623ff-2670-40ba-aa8e-0459f28216ea None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:39.667222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 126/234] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:39.673598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:39.674228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:39.674228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:39.697232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:39.698435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:39.784382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 109/235] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:39.828889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9623ff-2670-40ba-aa8e-0459f28216ea None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:39.845790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9623ff-2670-40ba-aa8e-0459f28216ea None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:39.857786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:39.857786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:39.857786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:39.857786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:39.873754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:39.880631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:39.881848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 127/236] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:39.887998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:39.897797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d81e-af35-4f69-b3a8-1decc6dd1715 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:39.908683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:39.909372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:39.909656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:39.909935 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:39.910698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:39.911006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:39.912656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:39.921700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 110/237] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:39.933338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:39.945817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f1440-d7c6-4e1d-aa3a-8d7496dfe7e0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:39.956478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:39.957712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:39.958208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:39.958681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] PATH_INFO: `/v3/users/33b455f4fe63416a83b4c6a76d494e4f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:39.960290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] RBAC: Authorizing `identity:get_user(user_id=33b455f4fe63416a83b4c6a76d494e4f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:39.963128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:39.965513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 128/238] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:39 2022] GET /identity/v3/users/33b455f4fe63416a83b4c6a76d494e4f => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:39.971568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:39.985733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a65fb-4fbf-46b1-b9ff-1266f9006885 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.001181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.001850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.002139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.002417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.016733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.018526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.034484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 111/239] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:40.039986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.053788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf6945-40d4-4fa0-8f27-be8c4eafc110 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.065435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091e0c3-9633-4275-a831-ba13b4c822c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.066663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e0c3-9633-4275-a831-ba13b4c822c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.067139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e0c3-9633-4275-a831-ba13b4c822c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.067642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091e0c3-9633-4275-a831-ba13b4c822c2 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.069220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091e0c3-9633-4275-a831-ba13b4c822c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.071796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091e0c3-9633-4275-a831-ba13b4c822c2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.073757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 129/240] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.080205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.096545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea116abe-680e-41a1-b9f3-1a47006b919d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.104113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.104826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.105115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.105394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.106300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=33b455f4fe63416a83b4c6a76d494e4f) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:40.106617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.109156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db3534-3556-492c-9008-a3a335f3a027 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.120900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 112/241] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/role_assignments?user.id=33b455f4fe63416a83b4c6a76d494e4f&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.161743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303f90-4a8f-44bc-a6fe-b5472aa112c7 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.162058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303f90-4a8f-44bc-a6fe-b5472aa112c7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.162312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e303f90-4a8f-44bc-a6fe-b5472aa112c7 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.164209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 130/242] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:40.175160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.175344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.175570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.205165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:40.206574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:40.225300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 113/243] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:40.265696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303f90-4a8f-44bc-a6fe-b5472aa112c7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.285261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e303f90-4a8f-44bc-a6fe-b5472aa112c7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.290138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810bde1-ceaa-4ec8-b7d1-6f921ae467de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.290944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810bde1-ceaa-4ec8-b7d1-6f921ae467de admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.291292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810bde1-ceaa-4ec8-b7d1-6f921ae467de admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.291582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810bde1-ceaa-4ec8-b7d1-6f921ae467de admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.310799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810bde1-ceaa-4ec8-b7d1-6f921ae467de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:40.318264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b810bde1-ceaa-4ec8-b7d1-6f921ae467de admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:40.319930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 131/244] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:40.325758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.333802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c971-a475-4652-945f-ced700639cb5 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.334091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c971-a475-4652-945f-ced700639cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.334377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38c971-a475-4652-945f-ced700639cb5 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.337971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 132/245] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:40.341091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e81f-9c21-4ae5-9c7d-6aa1214d2486 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.344184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.344478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.344762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.360068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.361021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.361311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.363759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.363759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:40.363759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.364387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.374352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 114/246] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.375883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:40.377267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:40.380838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.392348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de176630-287a-4cf4-9400-40abaa3f733d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.393018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 133/247] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:40.400261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.401644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.402158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.402666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] PATH_INFO: `/v3/users/3e5c213fbf524a25b081280ff44498eb` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.404925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e5c213fbf524a25b081280ff44498eb)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.407502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.410043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 115/248] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/users/3e5c213fbf524a25b081280ff44498eb => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.415713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.425854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.431425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8522-ef65-4eff-8fd6-d28b3bd45fb2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.438671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51710-f168-4b43-9413-e52219b88c90 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.443362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.443362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.443362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.444180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.445678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.447750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.452526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.452961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 134/249] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.454101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.454604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.455074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.461192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.469415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:40.477069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:40.477694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87fe52a-dee5-4782-aa6d-8065a25d49d1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.479003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 116/250] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:40.488626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.492455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.493347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.493625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.493895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/3e5c213fbf524a25b081280ff44498eb/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.500754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=497116fb453d468cb1d97b32fa046dfa, user_id=3e5c213fbf524a25b081280ff44498eb, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.502774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be4f57-c9f1-43b8-a26a-4e37651b9df3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.503405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.507668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.508437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.508788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.509072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.509829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:40.510138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.511725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccc7cb-c37a-474e-8064-ec47576ad2de admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.520577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 117/251] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.522057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e6fec-4832-451c-9906-1d8aac2e2260 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.522351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e6fec-4832-451c-9906-1d8aac2e2260 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.522632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e6fec-4832-451c-9906-1d8aac2e2260 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.531370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 118/252] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:40.531370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e6fec-4832-451c-9906-1d8aac2e2260 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.538439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e6fec-4832-451c-9906-1d8aac2e2260 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.542745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940bd69-8378-40b5-a0b3-0f0d5ad3f59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.543810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940bd69-8378-40b5-a0b3-0f0d5ad3f59e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.543954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940bd69-8378-40b5-a0b3-0f0d5ad3f59e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.544191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940bd69-8378-40b5-a0b3-0f0d5ad3f59e admin admin] PATH_INFO: `/v3/users/95e02af615f34082ae91e3661b24e132` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.558824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940bd69-8378-40b5-a0b3-0f0d5ad3f59e admin admin] RBAC: Authorizing `identity:get_user(user_id=95e02af615f34082ae91e3661b24e132)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.561592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940bd69-8378-40b5-a0b3-0f0d5ad3f59e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.563964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 119/253] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/users/95e02af615f34082ae91e3661b24e132 => generated 297 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.565097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.565353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.565637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.583464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:40.584738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:40.591623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 135/254] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:40 2022] PUT /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/3e5c213fbf524a25b081280ff44498eb/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:40.592720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.677484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 120/255] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:40.686406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bed14-6377-4f3e-beb3-694b3cb9cc8b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.691625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.692545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.692982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.693408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.703512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.704372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.705761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.714558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88c6d-0e4f-459a-a267-d35fc0713dc0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.718990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 136/256] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:40.720825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.721876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.722324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.722760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.724677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.736703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287433-6052-456b-be77-f06ae3e1da56 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.742555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:40.742896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.744007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.744428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.744841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.746249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.748628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.753942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:40.753942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 121/257] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:40.756140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 137/258] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:40.757916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.759263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.770905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397d89-5095-4958-9966-255b77751fe2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.775175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e2091-4a17-4eb6-8f77-0ca00905ca20 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.775816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.776542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.776828 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.777102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.777934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] RBAC: Adding query filter params (role.id=10af6e232dab44c8ad6d3d3dfbba17a6, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=95e02af615f34082ae91e3661b24e132) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:40.778240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.780731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d038d29-2037-430f-9bbc-410a96fd341c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.781538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.782414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.782846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.783224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.784839 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:40.785291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.787142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.788001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 122/259] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/role_assignments?user.id=95e02af615f34082ae91e3661b24e132&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=10af6e232dab44c8ad6d3d3dfbba17a6 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:40.793953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79345-d309-493c-bd6f-a9e089d77fb3 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.794242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79345-d309-493c-bd6f-a9e089d77fb3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.794523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f79345-d309-493c-bd6f-a9e089d77fb3 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.797524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 123/260] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:40.800799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 138/261] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:40.803360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.803648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.804671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.807007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.818226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b100-c73f-46b4-b9f3-00332e389261 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.824894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.825218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:40.826349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.826527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:40.827188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.827629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] PATH_INFO: `/v3/users/33b455f4fe63416a83b4c6a76d494e4f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.829247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] RBAC: Authorizing `identity:get_user(user_id=33b455f4fe63416a83b4c6a76d494e4f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.831682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.833693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 139/262] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/users/33b455f4fe63416a83b4c6a76d494e4f => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:40.834629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 124/263] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:40.839477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.850416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accb3a0-74f9-4dd9-9258-04896d8e8c8f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.854991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.855646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.855977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.856261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.861248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.867736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.870006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.870733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51d4b-3abb-40e9-b2ed-082509176480 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.876361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.877166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.877443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.877723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.878902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.880691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.882499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 125/264] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:40.883065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 140/265] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:40.888254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.889843 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.899283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba3392-afd6-4358-a9b7-3c9775c63741 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.901007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de47638-c9c4-44b0-ba75-afe47d87e51e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.904883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918602c-cf36-4dbd-8ca4-52b6cc0e0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.905734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918602c-cf36-4dbd-8ca4-52b6cc0e0bac admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.906081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918602c-cf36-4dbd-8ca4-52b6cc0e0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.906432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918602c-cf36-4dbd-8ca4-52b6cc0e0bac admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.907265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918602c-cf36-4dbd-8ca4-52b6cc0e0bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.908121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.909234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.909492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918602c-cf36-4dbd-8ca4-52b6cc0e0bac admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.909860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.910318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.911875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.914396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.916656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 141/266] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:40.923387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:40.933731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea18254-2e91-4f72-8770-e387781e5c97 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:40.939676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:40.945191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:40.945191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:40.945191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:40.945191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] RBAC: Adding query filter params (role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=33b455f4fe63416a83b4c6a76d494e4f) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:40.945191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:40.945555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4659472-4338-403b-a160-71fb770073a1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:40.952707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 142/267] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:40 2022] GET /identity/v3/role_assignments?user.id=33b455f4fe63416a83b4c6a76d494e4f&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:41.009519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 126/268] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:40 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:43.024520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85593a7-b631-4c98-ad2f-1e38450dd105 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.025040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85593a7-b631-4c98-ad2f-1e38450dd105 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.025117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85593a7-b631-4c98-ad2f-1e38450dd105 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.026903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 143/269] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:43.033470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.033942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.034020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.053086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:43.054322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:43.062881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 127/270] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:43.087954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85593a7-b631-4c98-ad2f-1e38450dd105 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.101804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85593a7-b631-4c98-ad2f-1e38450dd105 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.106625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.107759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.108277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.108565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.120713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:43.128878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:43.130134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 144/271] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:43.136052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.146267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167494d-17d7-49e9-bd9a-85f0fb5341e4 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.150827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.151496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.151782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.152094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.152856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:43.153166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.155253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.164587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 128/272] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:43.170477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.181217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ae6b-f5b5-4a0c-b3f2-2d0e293edda8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.186605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd31a5-80e4-4e1c-8023-1e12eca3f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.187558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd31a5-80e4-4e1c-8023-1e12eca3f66f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.187858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd31a5-80e4-4e1c-8023-1e12eca3f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.188155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd31a5-80e4-4e1c-8023-1e12eca3f66f admin admin] PATH_INFO: `/v3/users/3e5c213fbf524a25b081280ff44498eb` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.189507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd31a5-80e4-4e1c-8023-1e12eca3f66f admin admin] RBAC: Authorizing `identity:get_user(user_id=3e5c213fbf524a25b081280ff44498eb)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.191743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd31a5-80e4-4e1c-8023-1e12eca3f66f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.193862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 145/273] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/users/3e5c213fbf524a25b081280ff44498eb => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:43.199597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.211980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659b1e4-f105-41bf-a80e-2fe55800fc82 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.214601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69394fb-5343-412c-9ad5-e7fb2cf0a0a0 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.214889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69394fb-5343-412c-9ad5-e7fb2cf0a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.215179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69394fb-5343-412c-9ad5-e7fb2cf0a0a0 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.218141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 146/274] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:43.221151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.221818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.222106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.222389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.224415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.224702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.224980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.232886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.234652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.244409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:43.246017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 129/275] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:43.246317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:43.254112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.256659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 147/276] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:43.266061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34999b4-3673-4252-8ac4-2b530ee5ad6a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.270636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.271476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.271762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.272078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.273267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.275373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.277289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 130/277] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:43.282246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.283410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.292655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df5324-6fd9-4cf2-b0ac-1ed5c2ce210e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.293215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea2c5f-2c1e-4d4d-ac0e-56a156647b26 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.297893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.298551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.299106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.299279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.299532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.299815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.300204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.300664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.300761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=3e5c213fbf524a25b081280ff44498eb) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:43.300988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.303008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.309600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 131/278] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/role_assignments?user.id=3e5c213fbf524a25b081280ff44498eb&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:43.313427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:43.320751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:43.322407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 148/279] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:43.329221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.340118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9709b-74a3-4585-9816-1e32913bd9f7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.345275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.346325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.346825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.347360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.348361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:43.348881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.350726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.368570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 132/280] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:43.375064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.385577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab94c-c138-4eae-b22c-98f7f4b6a4e4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.391393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.392302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.392580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.392857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] PATH_INFO: `/v3/users/95e02af615f34082ae91e3661b24e132` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.394105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] RBAC: Authorizing `identity:get_user(user_id=95e02af615f34082ae91e3661b24e132)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.396309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.398307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 149/281] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/users/95e02af615f34082ae91e3661b24e132 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:43.404178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.416354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c895d8-0a67-4db4-b354-551cb173cad2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.421079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbabfa5-a028-4842-b9bb-1533653b7d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.422009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbabfa5-a028-4842-b9bb-1533653b7d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.422288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbabfa5-a028-4842-b9bb-1533653b7d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.422611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbabfa5-a028-4842-b9bb-1533653b7d12 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.423857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbabfa5-a028-4842-b9bb-1533653b7d12 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.426010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbabfa5-a028-4842-b9bb-1533653b7d12 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.427758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 133/282] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:43.433728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.445232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf189e-4972-4c94-98bb-b6cfd7ef2051 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.449881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ab5d4-a3ce-417b-9575-179941ab05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.451404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ab5d4-a3ce-417b-9575-179941ab05e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.451688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ab5d4-a3ce-417b-9575-179941ab05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.452015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ab5d4-a3ce-417b-9575-179941ab05e9 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/95e02af615f34082ae91e3661b24e132/roles/10af6e232dab44c8ad6d3d3dfbba17a6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.454000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ab5d4-a3ce-417b-9575-179941ab05e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497116fb453d468cb1d97b32fa046dfa, user_id=95e02af615f34082ae91e3661b24e132, role_id=10af6e232dab44c8ad6d3d3dfbba17a6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.456784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ab5d4-a3ce-417b-9575-179941ab05e9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.500837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeeb12-b013-4538-ab36-82b28a2f939e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.501122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeeb12-b013-4538-ab36-82b28a2f939e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.501401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeeb12-b013-4538-ab36-82b28a2f939e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.503221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 134/283] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:43.508831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.509119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.509491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.525225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 150/284] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:49:43 2022] PUT /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa/users/95e02af615f34082ae91e3661b24e132/roles/10af6e232dab44c8ad6d3d3dfbba17a6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:43.532083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:43.532083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:43.592442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978990-d5eb-4219-8657-9506eb6b9a89 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.593156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978990-d5eb-4219-8657-9506eb6b9a89 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.593495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62978990-d5eb-4219-8657-9506eb6b9a89 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.595667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 151/285] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:43.601343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.601694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.602039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.612096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 135/286] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:43.629504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:43.631176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:43.637746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.641931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 152/287] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:43.649155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e633e1-5c3d-4f37-acd2-19b7d27bbbd4 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.653969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.654886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.655169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.655447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.667465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:43.670436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.675264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:43.676816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 136/288] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:43.679916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e314572-66b5-40cf-9cea-d931722f7aaa None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.682609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.684454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.685320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.685596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.685870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.687079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.688818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.690464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 153/289] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:43.693652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba4c4-309e-4f51-a6c7-5067b7f521c2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.695918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.698555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.699227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.699515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.699796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.700600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:43.701575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.703099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.706478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be6ee0-94e2-4da9-b217-9cee0c77497d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.711237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946f65b-205a-42d5-a761-1dc9ba62ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.711929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f65b-205a-42d5-a761-1dc9ba62ad84 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.712212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f65b-205a-42d5-a761-1dc9ba62ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.712478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946f65b-205a-42d5-a761-1dc9ba62ad84 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.713193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946f65b-205a-42d5-a761-1dc9ba62ad84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.714968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 137/290] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:43.715073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946f65b-205a-42d5-a761-1dc9ba62ad84 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.724589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.734714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8283-1cac-42bf-81b7-52c2880fe8e2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.739152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.740089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.740403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.740693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] PATH_INFO: `/v3/users/67588307f41a40d2af6db835e1c0e2ff` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.755160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] RBAC: Authorizing `identity:get_user(user_id=67588307f41a40d2af6db835e1c0e2ff)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.757263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.758940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 138/291] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/users/67588307f41a40d2af6db835e1c0e2ff => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:43.765027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:43.774340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fe5f8-cf7d-4722-a6a8-36ab68b8356a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:43.778651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:43.780094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:43.780317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:43.780593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:43.781406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, user.id=67588307f41a40d2af6db835e1c0e2ff, scope.system=all) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:43.781714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:43.783560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3060cd1-b13e-4574-ad99-a8a887d5b3c7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:43.791130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 139/292] 10.222.0.91 () {56 vars in 1329 bytes} [Mon Feb 21 00:49:43 2022] GET /identity/v3/role_assignments?user.id=67588307f41a40d2af6db835e1c0e2ff&scope.system=all&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:44.076855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 154/293] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:49:43 2022] POST /identity/v3/users => generated 293 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:49:45.925890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520d27-fe95-47a9-a0db-ce5d24017371 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:45.926445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520d27-fe95-47a9-a0db-ce5d24017371 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:45.926445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0520d27-fe95-47a9-a0db-ce5d24017371 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:45.928237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 140/294] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:45.933556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:45.933959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:45.934124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:45.953368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:45.954562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:45.962932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 155/295] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:45.987318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520d27-fe95-47a9-a0db-ce5d24017371 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.000283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0520d27-fe95-47a9-a0db-ce5d24017371 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.004747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.005533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.005821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.006145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.018334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:46.025456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:46.026855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 141/296] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:46.033241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.042523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7ac90-8065-43d1-8e98-4f8cdcc5c2b1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.047431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.048124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.048409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.048687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.049506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:46.049816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.051406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.060390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 156/297] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:46.066078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.076767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ecbe2-0927-4607-bc19-61bfac73142a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.081581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279fff0-51f8-4478-b7c9-0614914d1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.082440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279fff0-51f8-4478-b7c9-0614914d1cad admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.082721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279fff0-51f8-4478-b7c9-0614914d1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.082998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279fff0-51f8-4478-b7c9-0614914d1cad admin admin] PATH_INFO: `/v3/users/95e02af615f34082ae91e3661b24e132` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.084380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279fff0-51f8-4478-b7c9-0614914d1cad admin admin] RBAC: Authorizing `identity:get_user(user_id=95e02af615f34082ae91e3661b24e132)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.086762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279fff0-51f8-4478-b7c9-0614914d1cad admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.088615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 142/298] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/users/95e02af615f34082ae91e3661b24e132 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:46.095008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.105038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87923-0f7e-4098-acd9-a8a03236d35b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.109649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.110297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.110580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.110862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.119538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.121435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.131851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 157/299] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:46.133018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312b14-f20a-4309-b448-20bf933c9b24 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.133311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312b14-f20a-4309-b448-20bf933c9b24 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.133594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0312b14-f20a-4309-b448-20bf933c9b24 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.137281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.140023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 143/300] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:46.141565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.141858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.142141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.147727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0481c8-492e-4cac-ac6d-5c60f2ce44ec admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.153375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.154416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.155291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.155581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.157099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.159352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.161256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:46.161614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 158/301] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:46.162684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:46.167648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.179853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f38f0-918a-4cdf-bf4f-06a8f15f54a9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.180135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 144/302] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:46.184486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.185875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.186226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.186512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.187360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] RBAC: Adding query filter params (role.id=10af6e232dab44c8ad6d3d3dfbba17a6, scope.project.id=497116fb453d468cb1d97b32fa046dfa, user.id=95e02af615f34082ae91e3661b24e132) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:46.187674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.189691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.196971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.197249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 159/303] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/role_assignments?user.id=95e02af615f34082ae91e3661b24e132&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=10af6e232dab44c8ad6d3d3dfbba17a6 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:46.207257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315f866-be4a-4238-bdf9-030393fa0657 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.212112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.212936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.213220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.213499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.226354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:46.233998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:46.235294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 145/304] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:46.241734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.253215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18844-c14a-4558-be58-6061e6e9c0ef admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.258177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.258858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.259143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.259419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.260219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:46.260528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.262363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.272788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 160/305] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:46.278605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.289614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c485e-a26a-427c-a40f-a8ae5b7a01cd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.294597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3c1db-3a05-4633-bad4-14500498966a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.295419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c1db-3a05-4633-bad4-14500498966a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.295622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c1db-3a05-4633-bad4-14500498966a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.295928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3c1db-3a05-4633-bad4-14500498966a admin admin] PATH_INFO: `/v3/users/67588307f41a40d2af6db835e1c0e2ff` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.297288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3c1db-3a05-4633-bad4-14500498966a admin admin] RBAC: Authorizing `identity:get_user(user_id=67588307f41a40d2af6db835e1c0e2ff)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.299582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3c1db-3a05-4633-bad4-14500498966a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.301604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 146/306] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/users/67588307f41a40d2af6db835e1c0e2ff => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:46.307355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.318480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eea00f-d729-4fc3-8b73-b123579d79f7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.323240 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.324198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.324528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.324874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] PATH_INFO: `/v3/system/users/67588307f41a40d2af6db835e1c0e2ff/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.327100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=67588307f41a40d2af6db835e1c0e2ff, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.328271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:46.328271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:46.328271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:46.329165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7e1a-7c2c-47c1-a813-0e3f864c36a4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.448389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 161/307] 10.222.0.91 () {58 vars in 1355 bytes} [Mon Feb 21 00:49:46 2022] PUT /identity/v3/system/users/67588307f41a40d2af6db835e1c0e2ff/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:46.556115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f820f-57a2-4248-b448-4c80a736f9a6 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.556405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f820f-57a2-4248-b448-4c80a736f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.556675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f820f-57a2-4248-b448-4c80a736f9a6 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.558621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 147/308] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:46.564170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0ea9-bdd3-45fd-bb34-ac8a425db21f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.564453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0ea9-bdd3-45fd-bb34-ac8a425db21f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.564729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c0ea9-bdd3-45fd-bb34-ac8a425db21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.586103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-1f3c0ea9-bdd3-45fd-bb34-ac8a425db21f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:46.587313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1f3c0ea9-bdd3-45fd-bb34-ac8a425db21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:46.596394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 162/309] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:46.619672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f820f-57a2-4248-b448-4c80a736f9a6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.632699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f820f-57a2-4248-b448-4c80a736f9a6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.633051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352d58-ce1d-4c96-a9a8-e3c3f8840114 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.633298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352d58-ce1d-4c96-a9a8-e3c3f8840114 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.633532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352d58-ce1d-4c96-a9a8-e3c3f8840114 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.635288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 163/310] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:46.637225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.637955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.638772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.639010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.640935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.641224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.641510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.654758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:46.662196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:46.662563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:46.664679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 148/311] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:46.664815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:46.669317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.678788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 164/312] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:46.679246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ac6a0-0dca-4ba1-8fb2-d4ebc5cc10b8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.683983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.684626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.685031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.685387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.686218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:46.686532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.688288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.700036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 149/313] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:46.702196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.703786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.711791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcffa1a6-fcf0-4444-b93c-39bb30c904c8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.713759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad3708-ac23-48c3-b9f8-e2f8ab07b71e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.716886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.717866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.718168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.718435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.719582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.719709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.720790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.721231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.721355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.721767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] PATH_INFO: `/v3/users/c0ac44232a1e42bdbcfe379b7f4b05dc` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.722913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 165/314] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:46.728389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.736568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] RBAC: Authorizing `identity:get_user(user_id=c0ac44232a1e42bdbcfe379b7f4b05dc)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.768179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.768308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8152c-9578-4c1f-ae18-52e13855f7dc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.768388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 150/315] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/users/c0ac44232a1e42bdbcfe379b7f4b05dc => generated 293 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:46.768457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.768457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.768457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.768457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] PATH_INFO: `/v3/groups` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.768722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.768800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:46.768868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:46.768868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:46.768868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:46.768868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67cb5-ea71-406f-99e2-0e1d18aa86b6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.769267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507966-78c8-434f-a0ab-080489e3b69b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:46.769267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:46.769267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:46.769267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:46.769561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:46.769561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] RBAC: Adding query filter params (role.id=10af6e232dab44c8ad6d3d3dfbba17a6, user.id=c0ac44232a1e42bdbcfe379b7f4b05dc, scope.system=all) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:46.769561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:46.769561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74735fd9-27a4-4aef-8398-31f5d945af84 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:46.769561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 151/316] 10.222.0.91 () {56 vars in 1329 bytes} [Mon Feb 21 00:49:46 2022] GET /identity/v3/role_assignments?user.id=c0ac44232a1e42bdbcfe379b7f4b05dc&scope.system=all&role.id=10af6e232dab44c8ad6d3d3dfbba17a6 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:46.899681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 166/317] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Feb 21 00:49:46 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:49:48.799432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a1db-60c4-4caf-a18a-2b3f30b821dd None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:48.800046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a1db-60c4-4caf-a18a-2b3f30b821dd None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:48.800046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859a1db-60c4-4caf-a18a-2b3f30b821dd None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:48.801947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 152/318] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:48.807008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:48.807520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:48.807665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:48.829833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:48.831338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:48.842965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 167/319] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:48.868932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a1db-60c4-4caf-a18a-2b3f30b821dd None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:48.883128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859a1db-60c4-4caf-a18a-2b3f30b821dd None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:48.887674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:48.889046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:48.889328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:48.889601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:48.903422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:48.911305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:48.913700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 153/320] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:48.920184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:48.930118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647b91-32c8-41d3-8ad9-3ca161de6817 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:48.936318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:48.936997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:48.937280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:48.937559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:48.938322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:48.938630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:48.940327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:48.954914 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 168/321] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:48.959946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:48.970488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30290738-e645-4110-b5c3-62c59015905a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:48.975753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567dc2-4240-48d1-969b-8c8395522c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:48.976750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567dc2-4240-48d1-969b-8c8395522c6d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:48.977128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567dc2-4240-48d1-969b-8c8395522c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:48.977501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567dc2-4240-48d1-969b-8c8395522c6d admin admin] PATH_INFO: `/v3/users/67588307f41a40d2af6db835e1c0e2ff` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:48.978963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567dc2-4240-48d1-969b-8c8395522c6d admin admin] RBAC: Authorizing `identity:get_user(user_id=67588307f41a40d2af6db835e1c0e2ff)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:48.981403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567dc2-4240-48d1-969b-8c8395522c6d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:48.987641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 154/322] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:48 2022] GET /identity/v3/users/67588307f41a40d2af6db835e1c0e2ff => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:48.989737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:48.999653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b720065-abb8-477c-8fd1-bf481ac5fcff admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.004592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.005432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.005893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.006348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.007371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] RBAC: Adding query filter params (role.id=d866912b115b4ffd92d5011a81e30fc3, user.id=67588307f41a40d2af6db835e1c0e2ff, scope.system=all) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:49.007947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:49.009971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df627dc0-d1a6-41df-878f-7ff3d25a6f92 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:49.036248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 169/323] 10.222.0.91 () {56 vars in 1329 bytes} [Mon Feb 21 00:49:48 2022] GET /identity/v3/role_assignments?user.id=67588307f41a40d2af6db835e1c0e2ff&scope.system=all&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 510 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:49.084580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12687d2-40dc-4b14-924a-9865eb332059 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.084762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12687d2-40dc-4b14-924a-9865eb332059 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.085045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12687d2-40dc-4b14-924a-9865eb332059 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.087453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 155/324] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:49.093318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.093602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.093884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.118077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:49.119647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:49.131874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 170/325] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:49.153139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12687d2-40dc-4b14-924a-9865eb332059 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:49.170875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12687d2-40dc-4b14-924a-9865eb332059 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.175880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.176673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.176955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.177232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.193049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:49.205218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:49.211621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 156/326] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:49.213442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:49.226809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014cba7-08cc-44e5-a55e-e7e20e248d5c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.231780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.232842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.232842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.233123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.233898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:49.234170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:49.235813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2e3e-c658-41c4-8a2f-8237fedb32ea admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:49.246536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 171/327] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:49.253883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:49.264868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e222dfd-a365-4070-8684-34a4eb660d77 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.273373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.274234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.274517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.274795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] PATH_INFO: `/v3/users/c0ac44232a1e42bdbcfe379b7f4b05dc` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.276659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] RBAC: Authorizing `identity:get_user(user_id=c0ac44232a1e42bdbcfe379b7f4b05dc)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:49.279458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:49.280774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18981845-a9e0-4e21-b2e0-f06d3829adde None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.281062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18981845-a9e0-4e21-b2e0-f06d3829adde None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.281171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 157/328] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:49 2022] GET /identity/v3/users/c0ac44232a1e42bdbcfe379b7f4b05dc => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:49.281339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18981845-a9e0-4e21-b2e0-f06d3829adde None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.283171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 172/329] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:49:49.286556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:49.288168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.288453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.288724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.296575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419994b-291b-4ef5-8c2d-2034528d65ef admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.300933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.301766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.302048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.302323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] PATH_INFO: `/v3/system/users/c0ac44232a1e42bdbcfe379b7f4b05dc/roles/10af6e232dab44c8ad6d3d3dfbba17a6` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.303760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0ac44232a1e42bdbcfe379b7f4b05dc, role_id=10af6e232dab44c8ad6d3d3dfbba17a6)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:49.304785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:49.304785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:49.304785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:49.305650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede4b9e-2b7b-4551-b1a6-80b176ae3f9c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:49.306363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:49.307547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:49.316361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 173/330] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:49.339910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:49.349188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea276f62-302a-4e98-b629-b9d1e42819a3 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.353669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.354507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.354798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.355082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.356285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:49.363631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:49.363631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 174/331] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:49:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:49.365473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:49.375428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94d037-f836-4594-9984-9616d55b0c79 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:49.379873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a43d8-667d-46dc-bd76-76c3e81dd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:49.380478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a43d8-667d-46dc-bd76-76c3e81dd418 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:49.380766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a43d8-667d-46dc-bd76-76c3e81dd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:49.381044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a43d8-667d-46dc-bd76-76c3e81dd418 admin admin] PATH_INFO: `/v3/groups` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:49.381704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a43d8-667d-46dc-bd76-76c3e81dd418 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:49.383583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a43d8-667d-46dc-bd76-76c3e81dd418 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:49.385116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 158/332] 10.222.0.91 () {58 vars in 1355 bytes} [Mon Feb 21 00:49:49 2022] PUT /identity/v3/system/users/c0ac44232a1e42bdbcfe379b7f4b05dc/roles/10af6e232dab44c8ad6d3d3dfbba17a6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:49:49.491867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 175/333] 10.222.0.91 () {60 vars in 1155 bytes} [Mon Feb 21 00:49:49 2022] POST /identity/v3/groups => generated 226 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:49:52.531167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6c63-69cd-4b18-bb48-be2a7e28b5e0 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.532240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6c63-69cd-4b18-bb48-be2a7e28b5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.532755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc6c63-69cd-4b18-bb48-be2a7e28b5e0 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.534744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 159/334] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:52.540359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.541223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.541728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.543510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1781-5619-49f0-a504-7a52dd5e3c53 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.543804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1781-5619-49f0-a504-7a52dd5e3c53 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.544152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b1781-5619-49f0-a504-7a52dd5e3c53 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.545896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 160/335] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:52.551167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.551455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.551737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.571506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:52.575867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:52.584110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:52.586796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:52.594547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 176/336] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:52.604891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 161/337] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:52.657691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.663634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.674490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9950a20-5e91-48c2-ac5c-b7e76543ab00 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.683403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b03ee-bd7d-45a9-a297-4e3f345addfd None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.684297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.685814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.686347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.686849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.692611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.693425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.693710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.693988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.705971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:52.712861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:52.718103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:52.719537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 162/338] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:52.725176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.726141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:52.727732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 177/339] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:52.733299 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.735636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e64df-4fa9-4019-912e-aeac646641d7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.746737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.749950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.750454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.750939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.756181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:52.758556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd12d-af85-4d67-b60a-d7ff5abcd2d3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.759099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.760971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.773558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.774545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.775059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.775543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.776555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:52.777071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.780000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.788146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 163/340] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:52.789332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.810499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 178/341] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:52.814635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809fdf1-e1fb-402f-ae2c-6d3bd0cbae1e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.816394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.833022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68246b8-ae25-4e29-8365-431cdc64825f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.833957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.834884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.835618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.836136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.851074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.853670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.854498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.855389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.855932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.856463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.876152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.879257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 164/342] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:52.881301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.884701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.903276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 179/343] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:52.906105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898e7e5-2b76-4be8-989b-0c857948c726 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.908848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.922543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.923754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.924291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.924778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.926286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.928573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.930866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac969dc-054d-45ac-9c9b-377b45858eb5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.934129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 165/344] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:52.938978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.948128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22fc45-9b3e-4cfa-bbda-50a0e557cf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.949274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22fc45-9b3e-4cfa-bbda-50a0e557cf81 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.949762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22fc45-9b3e-4cfa-bbda-50a0e557cf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.950456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22fc45-9b3e-4cfa-bbda-50a0e557cf81 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.953803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22fc45-9b3e-4cfa-bbda-50a0e557cf81 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.960669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22fc45-9b3e-4cfa-bbda-50a0e557cf81 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.963100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756076-33a3-4a02-bd16-25a9e5628486 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:52.965175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 180/345] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:52.968146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac7601-78cf-4202-b0f4-afde994edd22 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.969092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac7601-78cf-4202-b0f4-afde994edd22 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.969903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac7601-78cf-4202-b0f4-afde994edd22 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.972341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 181/346] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:52.973256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac7601-78cf-4202-b0f4-afde994edd22 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:52.976419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:52.977326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.977606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.977922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:52.985443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:52.986534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:52.986534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:49:52.986534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:49:52.988138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a152a-69ff-4bc2-88c4-1a693fa720aa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:52.991306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 166/347] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:52.992577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:52.992860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:52.993136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.002185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac7601-78cf-4202-b0f4-afde994edd22 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.013909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.015261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.015756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.016291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.020566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.021838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:49:53.021838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:49:53.021838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:49:53.023031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:53.023689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.025153 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:53.026179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 182/348] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:52 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.027163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.040082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 167/349] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:53.040861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.050305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a959-60e9-4b95-8be9-6b69d2e1f821 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.052488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afb253-6ee5-4717-b361-de4d7a892703 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.058914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.060405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.060719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.060997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.061941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:53.062256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.063546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.064340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.064679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.065185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.065685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.066720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:53.067251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.069354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c304968-2894-4ab5-82b3-55ccd2c3ce7f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.071220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 168/350] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.075863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.082902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 183/351] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.092766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dabc8-22de-4a87-9e16-aaf727948f56 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.097304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.098137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.098416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.098691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.112969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:53.120182 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:53.121745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 169/352] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:53.128174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213b96-dd8c-4254-80d3-c3d63e8486e1 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.128469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213b96-dd8c-4254-80d3-c3d63e8486e1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.128738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a213b96-dd8c-4254-80d3-c3d63e8486e1 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.130522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 184/353] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:53.131575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.136111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.136400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.136683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.142818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1217e6-0ecd-49a7-9bce-f84dd92f3761 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.147800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.149570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.149851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.150267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.151038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:53.151406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.153159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.167417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 170/354] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.173701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.189739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514c7ea-3bb4-482e-9f3c-e54267b4bf6a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.192712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:53.193925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:53.202817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.203499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.204938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.206402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.213056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 185/355] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 21 00:49:53.219037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.220884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.231289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 171/356] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:49:53.238136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.248945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5238f1-3651-43a0-8cbd-31d1596a20f3 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.259153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.260076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.260348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.260627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.261957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.264754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.266956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 186/357] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.272902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.284846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.290283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8db0-5448-4c71-8708-b5a9e5f596cf admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.306110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a5020-2285-4918-ab44-b66f01e16b73 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.306493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865921-3447-4d06-9296-75544f58679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.307481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865921-3447-4d06-9296-75544f58679d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.307763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865921-3447-4d06-9296-75544f58679d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.308068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16865921-3447-4d06-9296-75544f58679d admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.311423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.312345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.312629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.312798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865921-3447-4d06-9296-75544f58679d admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.312953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.314705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16865921-3447-4d06-9296-75544f58679d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.316900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 172/358] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.322935 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865921-3447-4d06-9296-75544f58679d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.332683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:53.348644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 00:49:53.350005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 187/359] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:53.358055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16865921-3447-4d06-9296-75544f58679d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.362900 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.370728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.371581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.371884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.372243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.373124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=497116fb453d468cb1d97b32fa046dfa) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:53.373508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.374354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381986e-51de-4f7a-ac4f-d1303d6c173f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.377485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.380537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.381214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.381549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.381827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.383301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:53.383627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.385667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.390545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 173/360] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 260 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.396039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 188/361] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:53.401952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.418008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca4619-d8b0-4fe9-a608-d96c258750d3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.429975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b9dc3-fea5-4302-8e13-10cb1a7850eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.430858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b9dc3-fea5-4302-8e13-10cb1a7850eb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.431140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b9dc3-fea5-4302-8e13-10cb1a7850eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.431418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b9dc3-fea5-4302-8e13-10cb1a7850eb admin admin] PATH_INFO: `/v3/users/c0ac44232a1e42bdbcfe379b7f4b05dc` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.433772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b9dc3-fea5-4302-8e13-10cb1a7850eb admin admin] RBAC: Authorizing `identity:get_user(user_id=c0ac44232a1e42bdbcfe379b7f4b05dc)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.436263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b9dc3-fea5-4302-8e13-10cb1a7850eb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.438194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 174/362] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/users/c0ac44232a1e42bdbcfe379b7f4b05dc => generated 293 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:53.444218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:53.459867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94e6dc-bb78-48e2-a087-0b135c129895 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:53.466846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:53.467557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:53.467857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:53.468231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:53.469081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] RBAC: Adding query filter params (role.id=10af6e232dab44c8ad6d3d3dfbba17a6, user.id=c0ac44232a1e42bdbcfe379b7f4b05dc, scope.system=all) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:53.469390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:53.471412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e64c43-bfd8-4b54-a379-ec7d8228286c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:53.492348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 189/363] 10.222.0.91 () {56 vars in 1329 bytes} [Mon Feb 21 00:49:53 2022] GET /identity/v3/role_assignments?user.id=c0ac44232a1e42bdbcfe379b7f4b05dc&scope.system=all&role.id=10af6e232dab44c8ad6d3d3dfbba17a6 => generated 510 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.098331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f231e-ab0c-4fdf-bace-4a46bf5f3775 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.099046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f231e-ab0c-4fdf-bace-4a46bf5f3775 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.099046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f231e-ab0c-4fdf-bace-4a46bf5f3775 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.100970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 175/364] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:54.107004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.107754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.107754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.136863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:54.138112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:54.146508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 190/365] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:54.185988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f231e-ab0c-4fdf-bace-4a46bf5f3775 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.201006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f231e-ab0c-4fdf-bace-4a46bf5f3775 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.207208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.208041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.208326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.208605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.222509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:54.229870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:54.235233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 176/366] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:54.237525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.247164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77d681-de95-4a0b-bdee-cdccaf0b1e20 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.255222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.255915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.256198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.256472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.257235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:54.257541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.259145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.275760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 191/367] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.282002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.297675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ff040-c83b-475b-b2e8-28882750c1b1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.307927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.308570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.308855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.309131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.324252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.326836 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.342228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 177/368] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:54.347827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.359863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bcff3-2ace-4028-a2fa-2a80ddea56bf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.368697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.369603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.369887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.370164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.371396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.374039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.378158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 192/369] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.383209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.397063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47febbd9-3c90-4ea2-a4eb-724457d6b811 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.409022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa716b-c1c4-4ed8-a75d-1089760fc85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.411866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa716b-c1c4-4ed8-a75d-1089760fc85e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.411866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa716b-c1c4-4ed8-a75d-1089760fc85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.411866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa716b-c1c4-4ed8-a75d-1089760fc85e admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.411866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa716b-c1c4-4ed8-a75d-1089760fc85e admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.413158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa716b-c1c4-4ed8-a75d-1089760fc85e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.414855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 178/370] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.420883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.431107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77be5-be03-42d3-8689-de46ec4ca229 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.440806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.441509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.441789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.442146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.443089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=497116fb453d468cb1d97b32fa046dfa) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:54.443403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.445340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e696270-c2bf-4047-bbd7-4befbf9c210a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.455683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 193/371] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:54.491704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32cf8f-5fe6-462a-81ac-a49609d692ab None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.492059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32cf8f-5fe6-462a-81ac-a49609d692ab None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.492283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32cf8f-5fe6-462a-81ac-a49609d692ab None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.494510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 179/372] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:54.502343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.502685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.502899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.527024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:54.528893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:54.537516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 194/373] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:54.578155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32cf8f-5fe6-462a-81ac-a49609d692ab None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.599490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32cf8f-5fe6-462a-81ac-a49609d692ab None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.608075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.608791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.609058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.609339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.632831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:54.639891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:54.644895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 180/374] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:54.647632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.658140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fb589-160a-435d-91f4-e552c608c3f4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.668060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.668782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.669594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.669921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.670657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:54.670993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.672750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.687191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 195/375] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.692927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.705621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a4e26-2eb7-4b46-b72b-acf5fab502e6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.711609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.712362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.712661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.712939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.723997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.725817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.736506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 181/376] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:49:54.741938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.754017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5543f-7ac3-43ae-8c5b-15dedd7970d7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.758734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.759651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.759971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.760255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] PATH_INFO: `/v3/projects/433e9f18a6614ea59825abd58da308b1` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.761607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] RBAC: Authorizing `identity:get_project(project_id=433e9f18a6614ea59825abd58da308b1)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.763558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.765429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 196/377] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/projects/433e9f18a6614ea59825abd58da308b1 => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.771031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.780154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5057e85-674e-4c7f-8684-1f215a00f4ed admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.784606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df877c7b-55ce-4b4b-8335-5fb7bda56ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.785447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877c7b-55ce-4b4b-8335-5fb7bda56ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.785729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877c7b-55ce-4b4b-8335-5fb7bda56ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.786021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877c7b-55ce-4b4b-8335-5fb7bda56ba6 admin admin] PATH_INFO: `/v3/groups/7535c6a3892d409096654f28ea4cd709` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.792413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df877c7b-55ce-4b4b-8335-5fb7bda56ba6 admin admin] RBAC: Authorizing `identity:get_group(group_id=7535c6a3892d409096654f28ea4cd709)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.794840 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df877c7b-55ce-4b4b-8335-5fb7bda56ba6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.796514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 182/378] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/groups/7535c6a3892d409096654f28ea4cd709 => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:54.802830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:54.816509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136e12f-6ba6-4202-95e0-2210644b88ed admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:54.825435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:54.826134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:54.826415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:54.826693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:54.827591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] RBAC: Adding query filter params (group.id=7535c6a3892d409096654f28ea4cd709, role.id=30d31529b5824c178844aea14bad4358, scope.project.id=433e9f18a6614ea59825abd58da308b1) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:54.827954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:54.829909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938fefe-c397-4054-b112-ed63ed993af3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:54.839569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 197/379] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:49:54 2022] GET /identity/v3/role_assignments?group.id=7535c6a3892d409096654f28ea4cd709&scope.project.id=433e9f18a6614ea59825abd58da308b1&role.id=30d31529b5824c178844aea14bad4358 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:55.995227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73b4e8-89f1-4245-b9bb-532283cc2c81 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:55.995973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73b4e8-89f1-4245-b9bb-532283cc2c81 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:55.995973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73b4e8-89f1-4245-b9bb-532283cc2c81 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:55.998299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 183/380] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:56.017854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.018514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.018514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.044258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:56.045472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:56.060679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 198/381] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:56.109987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73b4e8-89f1-4245-b9bb-532283cc2c81 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.122841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73b4e8-89f1-4245-b9bb-532283cc2c81 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.131998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.132795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.133074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.133345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.152106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:56.159029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:56.160265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 184/382] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:56.166128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.181045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb31e7a-905c-46fd-9897-e9aa307eeb22 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.192178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.192852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.193131 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.193404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.194161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:56.194465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.196074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.208282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 199/383] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.214025 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.223975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8df421-0eed-411e-9180-30c10bfdf6a2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.232155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.233017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.233292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.233562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.241021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.242982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.244836 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 185/384] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.251643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.266008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a09e6f-9902-4162-96c5-fb8460bd5ec1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.276201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea725a-2f69-4037-848a-ad3b41ebcac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.277062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea725a-2f69-4037-848a-ad3b41ebcac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.277339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea725a-2f69-4037-848a-ad3b41ebcac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.277608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea725a-2f69-4037-848a-ad3b41ebcac5 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.284665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea725a-2f69-4037-848a-ad3b41ebcac5 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.286737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea725a-2f69-4037-848a-ad3b41ebcac5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.288668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 200/385] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.294812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.304790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1a28e-68da-477d-ad2c-48c321cf7ef5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.313281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2f3b8-a610-4fba-a08d-b123847107fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.314178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f3b8-a610-4fba-a08d-b123847107fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.314459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f3b8-a610-4fba-a08d-b123847107fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.314735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2f3b8-a610-4fba-a08d-b123847107fa admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/groups/c4caffaa91de4786993890f5a79e6922/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.316739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f3b8-a610-4fba-a08d-b123847107fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c05be667654943b7b35cfdc0fd4ad0, group_id=c4caffaa91de4786993890f5a79e6922, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.319347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2f3b8-a610-4fba-a08d-b123847107fa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.409350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 186/386] 10.222.0.91 () {58 vars in 1463 bytes} [Mon Feb 21 00:49:56 2022] PUT /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/groups/c4caffaa91de4786993890f5a79e6922/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:56.451566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45e66c-e1be-4b28-9b09-0712a673a492 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.451911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45e66c-e1be-4b28-9b09-0712a673a492 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.452172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45e66c-e1be-4b28-9b09-0712a673a492 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.454198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 201/387] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:56.460699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.461317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.461778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.486716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89becf19-a366-4dc3-8899-8442042e53d6 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.487305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89becf19-a366-4dc3-8899-8442042e53d6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.488131 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89becf19-a366-4dc3-8899-8442042e53d6 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.490989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 202/388] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:56.494697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:56.496222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:56.505559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.506119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.506594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.546863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:56.548467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:56.639138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 203/389] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:56.651786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 187/390] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:56.665646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.675380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a887a-67ce-4aeb-9793-900f145beba2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.681100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.681786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.682877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.683379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.683891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.693680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db867afd-501d-4ec7-b4f4-6e32b7327f2d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.696477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:56.703265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.704090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.704371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.704645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.705963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:56.707790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 204/391] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:56.714006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.720475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:56.727336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:56.727617 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa206e7-a5a3-4049-92c0-97574fb1b9b2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.728915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 188/392] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:49:56.736506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.738420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.739350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.739889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.740392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.741420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:56.742233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.745023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.747545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dce39-3dbd-4b2f-be35-9f1ff2475f52 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.752956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.753673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.753961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.754244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.755049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:56.755362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.757188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.758260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 205/393] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:56.765788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.781022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 189/394] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.783676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf83d5-0927-4268-a9c4-eeaa74870788 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.787332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.799270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ad25-ec08-40c0-9d27-879c5d1fa277 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.800556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.801415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.801696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.801986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.803515 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.805465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.807237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 206/395] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.813240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.814171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.814453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.814732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.816178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.817163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.819052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.820682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 190/396] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:49:56.830105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.832824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc89761-5764-4dfc-9b48-5d29c57b58e8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.845074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ded28-6e01-4a0c-a15e-b27882d4231a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.847581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.848475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.848757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.849039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.850542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.852744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.854725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 207/397] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.858812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.859673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.859988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.860265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.861477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.862905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.864898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.874489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 191/398] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:56 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:56.874920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:56.878631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b88401-54c5-4993-ba39-3cfaea9d117f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.883654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69b5b6-8808-4d1c-9ac8-f981d7d3a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.884208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b5b6-8808-4d1c-9ac8-f981d7d3a6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.884495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b5b6-8808-4d1c-9ac8-f981d7d3a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.884771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69b5b6-8808-4d1c-9ac8-f981d7d3a6a4 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/groups/c4caffaa91de4786993890f5a79e6922/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.888575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b5b6-8808-4d1c-9ac8-f981d7d3a6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c05be667654943b7b35cfdc0fd4ad0, group_id=c4caffaa91de4786993890f5a79e6922, role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.889884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351aa1-92be-44b3-abbe-5c7272b0415c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:56.891224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69b5b6-8808-4d1c-9ac8-f981d7d3a6a4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.896091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1065f25-0ea0-498c-9460-6f9b10002ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:56.897409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065f25-0ea0-498c-9460-6f9b10002ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:56.898002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065f25-0ea0-498c-9460-6f9b10002ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:56.898482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1065f25-0ea0-498c-9460-6f9b10002ebf admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa/groups/c4caffaa91de4786993890f5a79e6922/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:56.900922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1065f25-0ea0-498c-9460-6f9b10002ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=497116fb453d468cb1d97b32fa046dfa, group_id=c4caffaa91de4786993890f5a79e6922, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:56.904534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1065f25-0ea0-498c-9460-6f9b10002ebf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:56.982040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 208/399] 10.222.0.91 () {58 vars in 1463 bytes} [Mon Feb 21 00:49:56 2022] PUT /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0/groups/c4caffaa91de4786993890f5a79e6922/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:49:57.019749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 192/400] 10.222.0.91 () {58 vars in 1463 bytes} [Mon Feb 21 00:49:56 2022] PUT /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa/groups/c4caffaa91de4786993890f5a79e6922/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:57.663716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a4c5-099d-4803-bf2b-ea715bd9f94b None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.664250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a4c5-099d-4803-bf2b-ea715bd9f94b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.664250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295a4c5-099d-4803-bf2b-ea715bd9f94b None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.666160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 209/401] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:57.672760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.673387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.673882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.697193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:57.698723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:57.780972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 193/402] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:57.804140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a4c5-099d-4803-bf2b-ea715bd9f94b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:57.825728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295a4c5-099d-4803-bf2b-ea715bd9f94b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:57.833365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:57.834171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.834459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.834982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.847477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:57.854715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:49:57.855930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 210/403] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:57.862441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:57.872695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255c7e8-676b-48c4-b4d0-ffeab74c3610 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:57.877660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:57.878408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.879034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.879388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.880268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:57.880643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:57.882326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:57.895947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 194/404] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:57.898101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:57.909791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54c90-b284-4fe7-b58e-be12a97b1d49 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:57.916430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:57.917337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.917687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.918039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.920209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:57.922231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:57.927967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 211/405] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:57 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:57.929901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:57.941740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f1119-1861-47c6-87e1-5c924a71a480 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:57.948118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4f56d-aba3-4fbf-b81c-16dd08b8a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:57.949100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f56d-aba3-4fbf-b81c-16dd08b8a54d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.949513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f56d-aba3-4fbf-b81c-16dd08b8a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.949920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f56d-aba3-4fbf-b81c-16dd08b8a54d admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.952577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4f56d-aba3-4fbf-b81c-16dd08b8a54d admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:57.954842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4f56d-aba3-4fbf-b81c-16dd08b8a54d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:57.956728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 195/406] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:57 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:57.965830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:57.976457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ffad5-3f89-45b9-bb02-4b3a0eea568e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:57.984293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff510b-77c6-4691-910b-fde70ee73307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:57.985299 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff510b-77c6-4691-910b-fde70ee73307 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:57.985641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff510b-77c6-4691-910b-fde70ee73307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:57.985921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff510b-77c6-4691-910b-fde70ee73307 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa/groups/c4caffaa91de4786993890f5a79e6922/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:57.988351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff510b-77c6-4691-910b-fde70ee73307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497116fb453d468cb1d97b32fa046dfa, group_id=c4caffaa91de4786993890f5a79e6922, role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:57.991188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff510b-77c6-4691-910b-fde70ee73307 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:58.077653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 212/407] 10.222.0.91 () {58 vars in 1463 bytes} [Mon Feb 21 00:49:57 2022] PUT /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa/groups/c4caffaa91de4786993890f5a79e6922/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:58.147450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e50f-6bee-4ffb-aefc-17cc3acd5060 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.148152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e50f-6bee-4ffb-aefc-17cc3acd5060 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.148152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e50f-6bee-4ffb-aefc-17cc3acd5060 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.149817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 196/408] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:58.155827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.156283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.156564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.175724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:58.176862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:58.250333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 213/409] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:49:58.285267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e50f-6bee-4ffb-aefc-17cc3acd5060 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:58.298081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e50f-6bee-4ffb-aefc-17cc3acd5060 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:58.302566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:58.303473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.303756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.304058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.318548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:58.326723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:49:58.328006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 197/410] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:49:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:58.336707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:58.346366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895efcb-3640-4f8a-a516-bcbb1020110c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:58.355868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:58.356272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.356498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.356744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.357540 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:58.358421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:58.359927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:58.369263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 214/411] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:58.375533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:58.388933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df640d-4775-41d3-b521-09e8f35c3c32 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:58.396343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:58.397405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.397689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.397963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] PATH_INFO: `/v3/groups/7535c6a3892d409096654f28ea4cd709` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.399262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] RBAC: Authorizing `identity:get_group(group_id=7535c6a3892d409096654f28ea4cd709)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:58.401473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:58.403505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 198/412] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:58 2022] GET /identity/v3/groups/7535c6a3892d409096654f28ea4cd709 => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:58.409085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:58.420658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d889a7-d05b-4b77-ac19-148b3cfea9c6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:58.428000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa8d21-870b-4ab6-a112-f8104348e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:58.428795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8d21-870b-4ab6-a112-f8104348e8db admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.429119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8d21-870b-4ab6-a112-f8104348e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.429394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa8d21-870b-4ab6-a112-f8104348e8db admin admin] PATH_INFO: `/v3/projects/433e9f18a6614ea59825abd58da308b1` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.430684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8d21-870b-4ab6-a112-f8104348e8db admin admin] RBAC: Authorizing `identity:get_project(project_id=433e9f18a6614ea59825abd58da308b1)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:58.432698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa8d21-870b-4ab6-a112-f8104348e8db admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:58.435407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 215/413] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:58 2022] GET /identity/v3/projects/433e9f18a6614ea59825abd58da308b1 => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:58.441164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:58.455881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ade2b-0a9e-4dfa-a2fa-b58cd4427af8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:58.461194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ff434-6590-467e-8292-fa54f9ddb23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:58.462168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ff434-6590-467e-8292-fa54f9ddb23e admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:58.462447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ff434-6590-467e-8292-fa54f9ddb23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:58.462722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ff434-6590-467e-8292-fa54f9ddb23e admin admin] PATH_INFO: `/v3/projects/433e9f18a6614ea59825abd58da308b1/groups/7535c6a3892d409096654f28ea4cd709/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:58.465589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ff434-6590-467e-8292-fa54f9ddb23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=433e9f18a6614ea59825abd58da308b1, group_id=7535c6a3892d409096654f28ea4cd709, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:58.468614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ff434-6590-467e-8292-fa54f9ddb23e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:58.556306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 199/414] 10.222.0.91 () {58 vars in 1463 bytes} [Mon Feb 21 00:49:58 2022] PUT /identity/v3/projects/433e9f18a6614ea59825abd58da308b1/groups/7535c6a3892d409096654f28ea4cd709/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:49:59.553112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9bef-395c-4687-b534-a0f2fa515779 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.553615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9bef-395c-4687-b534-a0f2fa515779 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.553691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c9bef-395c-4687-b534-a0f2fa515779 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.555685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 216/415] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:49:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:49:59.578433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.578969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.578969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.609052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:49:59.610189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:49:59.678664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 200/416] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:49:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:49:59.704719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9bef-395c-4687-b534-a0f2fa515779 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:59.722584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c9bef-395c-4687-b534-a0f2fa515779 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:59.732426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:59.733571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.735879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.735879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.757088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:49:59.765717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:49:59.767632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 217/417] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:49:59.773344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:59.786529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d3a44-a679-4524-b382-c43e86b3ba7d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:59.800409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:59.801098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.801381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.801654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.802416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:59.802721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:59.804434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:59.817742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 201/418] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:49:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:59.823498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:59.838986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c636f-4b11-4aec-8ced-277077ebd3ea admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:59.845376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:59.846258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.846729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.847211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.863708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:59.865780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:59.879498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 218/419] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:49:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:49:59.884806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:59.899272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97309b3a-0ae0-4d8e-9d98-13e2766b1c21 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:59.907314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:59.908207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.908495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.908766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.912651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:59.914728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:59.916845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 202/420] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:49:59 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:59.923012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:59.936240 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40210f6-8470-4e66-9c94-a98408912b93 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:59.944169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42648e-c1e2-4c28-a8cd-1b5b68912164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:59.945238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42648e-c1e2-4c28-a8cd-1b5b68912164 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.945709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42648e-c1e2-4c28-a8cd-1b5b68912164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.946166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42648e-c1e2-4c28-a8cd-1b5b68912164 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.947536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42648e-c1e2-4c28-a8cd-1b5b68912164 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:59.949671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42648e-c1e2-4c28-a8cd-1b5b68912164 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:59.952433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 219/421] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:49:59 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:49:59.958286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:49:59.971359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109c8d-92e9-470e-889e-9f2ad8a47d8a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:49:59.979990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:49:59.980642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:49:59.980923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:49:59.981716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:49:59.982544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:49:59.982853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:49:59.984710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb416a6a-4445-4f86-8fba-f072a5d3e063 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:49:59.997229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 203/422] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:49:59 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:00.172656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac371-e9a9-4a26-9702-8da238b248d9 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.173261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac371-e9a9-4a26-9702-8da238b248d9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.173762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac371-e9a9-4a26-9702-8da238b248d9 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.176103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 220/423] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:00.181281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d472a-0875-493c-abc7-b3ecf5bc6c05 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.181907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d472a-0875-493c-abc7-b3ecf5bc6c05 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.182400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d472a-0875-493c-abc7-b3ecf5bc6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.206167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-742d472a-0875-493c-abc7-b3ecf5bc6c05 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:00.207379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-742d472a-0875-493c-abc7-b3ecf5bc6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:00.222919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 204/424] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:00.236505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c3241-7cbf-4458-81cc-0efd3f6e8a01 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.237123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c3241-7cbf-4458-81cc-0efd3f6e8a01 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.237626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c3241-7cbf-4458-81cc-0efd3f6e8a01 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.239763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 221/425] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:00.245746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.246038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.246320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.269070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:00.270285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:00.283537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 205/426] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:00.286291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c3241-7cbf-4458-81cc-0efd3f6e8a01 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.312057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c3241-7cbf-4458-81cc-0efd3f6e8a01 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.321017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.321939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.322227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.322510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.333543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.341683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:00.343504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4e44-ea6d-4989-9042-59885e0bf63b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.349244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:50:00.350760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 222/427] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:00.358949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.359417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.359771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.360080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.360361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.370346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c70de-792c-4c8e-8384-de6fbee93801 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.375924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.376648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.376931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.377252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.378108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:00.378415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.380225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.389114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:00.391502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 223/428] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:00.396193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 00:50:00.397069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.397668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 206/429] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:00.403082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.409080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7db6b-a883-494d-9a93-b280798abadc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.414438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.419858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.419858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.419858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.420136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c3d22-5cc1-4478-a9b3-bde3a08b735c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.425605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.427529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.438397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.439067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.439348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.439584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 224/430] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:50:00.439709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.440435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:00.440741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.442348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.445597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.456625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a8896-180c-4486-a7e0-f4e0f5ff192c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.457574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 207/431] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:00.461509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.462651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.462936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.463209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] PATH_INFO: `/v3/projects/21c05be667654943b7b35cfdc0fd4ad0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.463457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.464534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] RBAC: Authorizing `identity:get_project(project_id=21c05be667654943b7b35cfdc0fd4ad0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.466615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.468569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 225/432] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/projects/21c05be667654943b7b35cfdc0fd4ad0 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:00.475243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.479481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3839fb2-4c42-4667-8b0f-6561436c2d62 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.486838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6a550-2ed6-4f87-ab5a-0cc2467a4aa7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.487087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.487888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.488169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.488531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.492317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.493152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.493490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.493770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.495064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.497804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.498199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.499813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 226/433] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:00.501989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.505680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.512231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 208/434] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:50:00.517372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a73b71-c7d7-41fc-ac18-79df4e1145b0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.518911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.524154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.524813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.525100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.525375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.526250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=21c05be667654943b7b35cfdc0fd4ad0) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:00.526530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.529032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.529467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bbf97-5aa3-49ee-83cc-28591957feff admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.539464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.540082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 227/435] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=21c05be667654943b7b35cfdc0fd4ad0&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:00.540359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.540644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.540917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.543398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.546295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.548515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 209/436] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:00.553957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.567807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a93f9-7964-4617-9bc3-2d1451dae581 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.573152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfb2db-ff85-46da-ab5e-7e58dfa17dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.574015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb2db-ff85-46da-ab5e-7e58dfa17dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.574301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb2db-ff85-46da-ab5e-7e58dfa17dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.574581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfb2db-ff85-46da-ab5e-7e58dfa17dc9 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.576642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfb2db-ff85-46da-ab5e-7e58dfa17dc9 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.578636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfb2db-ff85-46da-ab5e-7e58dfa17dc9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.580615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 228/437] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:00.586830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:00.598668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8beac2-5719-43e6-9ba3-c4888f38b438 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:00.603260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:00.603947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:00.604233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:00.604509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:00.605344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=d866912b115b4ffd92d5011a81e30fc3, scope.project.id=497116fb453d468cb1d97b32fa046dfa) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:00.605657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:00.608207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc021-868a-47b1-8352-0ce873463971 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:00.616667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 210/438] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:50:00 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=d866912b115b4ffd92d5011a81e30fc3 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:01.510777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac4cce-c6e3-43a7-b3b4-3112a765739c None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.511061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac4cce-c6e3-43a7-b3b4-3112a765739c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.511339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac4cce-c6e3-43a7-b3b4-3112a765739c None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.513729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 229/439] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:01.518858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056ade-6ebd-4d76-be52-5c669c7af3ef None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.519148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056ade-6ebd-4d76-be52-5c669c7af3ef None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.519425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056ade-6ebd-4d76-be52-5c669c7af3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.537322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f8056ade-6ebd-4d76-be52-5c669c7af3ef None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:01.538472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f8056ade-6ebd-4d76-be52-5c669c7af3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:01.546069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 211/440] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:01.569382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac4cce-c6e3-43a7-b3b4-3112a765739c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.581942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac4cce-c6e3-43a7-b3b4-3112a765739c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.586454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c98da-b772-4c08-bcdc-623db0fe193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.587227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c98da-b772-4c08-bcdc-623db0fe193e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.587512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c98da-b772-4c08-bcdc-623db0fe193e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.587790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c98da-b772-4c08-bcdc-623db0fe193e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.598526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c98da-b772-4c08-bcdc-623db0fe193e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:01.605230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3760-c7de-4b14-b66f-40a3b43f601c None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.605691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3760-c7de-4b14-b66f-40a3b43f601c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.605778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3760-c7de-4b14-b66f-40a3b43f601c None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.605893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-1f7c98da-b772-4c08-bcdc-623db0fe193e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:50:01.607017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 230/441] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:01.607971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 212/442] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:01.612653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3760-c7de-4b14-b66f-40a3b43f601c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.612978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.613265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.613544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.626956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3760-c7de-4b14-b66f-40a3b43f601c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.631330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:01.631469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.632009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.632294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.632548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:01.632661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.633309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:01.633613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.635295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.641213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 231/443] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:01.644310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 213/444] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:01.649650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.659517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc86a2-6649-446b-8492-7e16e69f2cb4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.663953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.664593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.664880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.665017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.665159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.673118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.674622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b7ea9-37c8-40ff-adb5-17383e7d2efd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.674872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.678941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.679702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.680033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.680312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.683699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 232/445] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:50:01.689195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.690847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:01.697613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:01.697782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6465f0-2861-4fa9-94a4-0ff56e5c96f8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.698904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 214/446] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:01.703568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.704521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.704805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.704973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.705071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] PATH_INFO: `/v3/projects/497116fb453d468cb1d97b32fa046dfa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.706241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] RBAC: Authorizing `identity:get_project(project_id=497116fb453d468cb1d97b32fa046dfa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.708307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.710198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 233/447] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/projects/497116fb453d468cb1d97b32fa046dfa => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:01.715146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.716759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13056eee-e2a8-42b7-bc76-7b97739a6a61 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.721104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.721734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.722019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.722299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.723037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:01.723358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.724942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.725066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066bbc5-fa23-4df0-b822-b13e9b6fdf51 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.729460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.730260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.730544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.730819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] PATH_INFO: `/v3/groups/c4caffaa91de4786993890f5a79e6922` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.732358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] RBAC: Authorizing `identity:get_group(group_id=c4caffaa91de4786993890f5a79e6922)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.733575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 215/448] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:01.736583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.738149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 234/449] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/groups/c4caffaa91de4786993890f5a79e6922 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:01.738927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.743456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.749219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a980f-e809-43b3-89ff-34c8f59f4c54 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.753618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.754237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.754554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.754861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.757108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3161889-47fb-4757-bb1a-f88be0a822e0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.761386 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.762002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.762808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.763195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.764049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] RBAC: Adding query filter params (group.id=c4caffaa91de4786993890f5a79e6922, role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=497116fb453d468cb1d97b32fa046dfa) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:01.764150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.764359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.765881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.766191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.771991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 235/450] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/role_assignments?group.id=c4caffaa91de4786993890f5a79e6922&scope.project.id=497116fb453d468cb1d97b32fa046dfa&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:01.774851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 216/451] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:50:01.781093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.791186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28b1fa-2f47-4730-9b1f-a126516d7946 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.796739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.797608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.797908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.798162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] PATH_INFO: `/v3/projects/433e9f18a6614ea59825abd58da308b1` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.799402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] RBAC: Authorizing `identity:get_project(project_id=433e9f18a6614ea59825abd58da308b1)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.801295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.803218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 236/452] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/projects/433e9f18a6614ea59825abd58da308b1 => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:01.808759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.819361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68044ae1-5966-40f2-a8f4-887250a8189d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.823900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ba2e-e732-4df6-868b-aed5135dcfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.826442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ba2e-e732-4df6-868b-aed5135dcfaf admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.826442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ba2e-e732-4df6-868b-aed5135dcfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.826442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ba2e-e732-4df6-868b-aed5135dcfaf admin admin] PATH_INFO: `/v3/groups/7535c6a3892d409096654f28ea4cd709` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.827496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ba2e-e732-4df6-868b-aed5135dcfaf admin admin] RBAC: Authorizing `identity:get_group(group_id=7535c6a3892d409096654f28ea4cd709)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.829543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ba2e-e732-4df6-868b-aed5135dcfaf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.831269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 217/453] 10.222.0.91 () {56 vars in 1201 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/groups/7535c6a3892d409096654f28ea4cd709 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:01.837898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:01.849622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b9d52-7421-4da9-848f-6148112d8310 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:01.854394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:01.855057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:01.855345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:01.855628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:01.857775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] RBAC: Adding query filter params (group.id=7535c6a3892d409096654f28ea4cd709, role.id=30d31529b5824c178844aea14bad4358, scope.project.id=433e9f18a6614ea59825abd58da308b1) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:01.858145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:01.860031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b85d6-f510-4df6-9cbd-6675eeca6db4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:01.866940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 237/454] 10.222.0.91 () {56 vars in 1397 bytes} [Mon Feb 21 00:50:01 2022] GET /identity/v3/role_assignments?group.id=7535c6a3892d409096654f28ea4cd709&scope.project.id=433e9f18a6614ea59825abd58da308b1&role.id=30d31529b5824c178844aea14bad4358 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:05.099742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c04d0-4572-4e6d-a431-68b7ad19fb76 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.100317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c04d0-4572-4e6d-a431-68b7ad19fb76 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.100317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c04d0-4572-4e6d-a431-68b7ad19fb76 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.102349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 218/455] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:05.108090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.108527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.108625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.120221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303a97-c048-4c6d-b6f2-a35e68ce0d60 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.120817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303a97-c048-4c6d-b6f2-a35e68ce0d60 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.121326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303a97-c048-4c6d-b6f2-a35e68ce0d60 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.123531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 219/456] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:05.129102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ef14-ab34-410c-a3e6-47b14a765112 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.129398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ef14-ab34-410c-a3e6-47b14a765112 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.129736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893ef14-ab34-410c-a3e6-47b14a765112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.131648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:05.133106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:05.154983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5893ef14-ab34-410c-a3e6-47b14a765112 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:05.156647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 238/457] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:05.157401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5893ef14-ab34-410c-a3e6-47b14a765112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:05.175272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 220/458] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:05.181227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.193846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965378e-26b5-4961-a5b8-2dbb26f0e8cf None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.194465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965378e-26b5-4961-a5b8-2dbb26f0e8cf None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.194944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965378e-26b5-4961-a5b8-2dbb26f0e8cf None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.196994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 221/459] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:05.197132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9d720-6eb7-4991-a2e6-0311074fe964 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.203136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.203427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.203702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.209680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.210480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.210821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.211103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.222824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.224459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:05.224706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.225633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:05.235381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 222/460] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:05.236342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.242514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:05.243982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 239/461] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:05.245498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa9b74-dbc4-400a-a71c-9466c5b87828 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.249830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.261394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.262705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.262979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.263252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.269526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43995e-4565-41c5-acad-1870dd4ae562 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.274420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.275328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.275860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.276347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.277227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.277576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:05.278605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.279699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.280841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.294915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 240/462] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:05.295085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.298635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:05.299817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 223/463] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:05.300864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.309129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2492fb-9c08-4d62-9ba9-5aa87985a324 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.311560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33cf18-3021-464a-ba7d-0ed42ef66521 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.313842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.314624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.314911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.315187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.316817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.317804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.318595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.319028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.319916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.321959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.327824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.329813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.348427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:05.349934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 241/464] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:05.355881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.363233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35e8f4-1fe6-4e73-82aa-196b489abe0b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.370208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.371046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.371389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.372017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.372878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:05.373195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.377064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.389130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 242/465] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:05.394165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.404495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 224/466] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/users => generated 246 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:05.407658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d223c1c-e1ad-4d90-be94-69fdf418a1e5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.411572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.420480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287010be-ad3d-4efc-a17e-39fce97d2b7b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.422028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.428117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.428117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.428117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.428117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:05.428117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.428117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.439057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721f043-6f1e-45c0-95eb-6c101ba38f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.440166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f043-6f1e-45c0-95eb-6c101ba38f9c admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.440708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f043-6f1e-45c0-95eb-6c101ba38f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.441187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721f043-6f1e-45c0-95eb-6c101ba38f9c admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.442099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f043-6f1e-45c0-95eb-6c101ba38f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.445274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721f043-6f1e-45c0-95eb-6c101ba38f9c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.453058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 243/467] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:05.459091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.478092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27979-dd76-48be-81e3-1da84c968e3e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.484054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e74e1-98d0-4766-aa8e-38aab1b3e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.484747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e74e1-98d0-4766-aa8e-38aab1b3e461 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.485046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e74e1-98d0-4766-aa8e-38aab1b3e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.485634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e74e1-98d0-4766-aa8e-38aab1b3e461 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.486429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e74e1-98d0-4766-aa8e-38aab1b3e461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.488573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e74e1-98d0-4766-aa8e-38aab1b3e461 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.522039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 225/468] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/users => generated 248 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:05.583332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 244/469] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/users => generated 248 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:05.847280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09806f5-46a9-4f62-8d25-386773355e55 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.847653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09806f5-46a9-4f62-8d25-386773355e55 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.847866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09806f5-46a9-4f62-8d25-386773355e55 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.849934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 226/470] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:05.855592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.856361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.857057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.878449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:05.883644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:05.891790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 245/471] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:05.917144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09806f5-46a9-4f62-8d25-386773355e55 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.931429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09806f5-46a9-4f62-8d25-386773355e55 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:05.936781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:05.937590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:05.937849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:05.938127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:05.953904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:05.955825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:05.974012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:05.975547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 227/472] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:05.981526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:05.991428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75054c-ba3b-46dd-905a-3107cb31abab None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:06.003891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:06.004998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.005537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.006017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.006951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:06.007511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:06.009360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db2352-491d-45a9-a418-b7985580d131 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:06.027370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 246/473] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:06.034051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:06.052978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa4246-5663-4d0c-b4d4-1d211dedebc4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:06.065108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:06.065782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.066067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.066349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.067057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:06.069031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:06.155103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464deca2-5419-41f1-93c5-dc00484421d5 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.156106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464deca2-5419-41f1-93c5-dc00484421d5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.156608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464deca2-5419-41f1-93c5-dc00484421d5 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.158583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 247/474] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:06.164356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.164869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.171541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.185272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:06.186759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:06.200010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 248/475] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:06.212747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 228/476] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:06 2022] POST /identity/v3/users => generated 249 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:06.221460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:06.232385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f08c0b-ca8e-4541-862e-ee00ed772145 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:06.237467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:06.238380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.238867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.239388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.240446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:06.242253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:06.304099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.sql.core [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 21 00:50:06.304099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 21 00:50:06.304099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [parameters: {'id': '9442a9f1c9cf489387716cb1f4b1c48e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 21 00:50:06.304099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79590) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 00:50:06.319674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 21 00:50:06.326400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 249/477] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 00:50:06 2022] POST /identity/v3/roles => generated 144 bytes in 105 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:06.332823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:06.349363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2421c-7e65-4571-9252-94379222d5ea admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:06.357712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ea4cc-91e0-4f5e-98a9-d4608fbcf791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:06.358577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea4cc-91e0-4f5e-98a9-d4608fbcf791 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.358874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea4cc-91e0-4f5e-98a9-d4608fbcf791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.359170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea4cc-91e0-4f5e-98a9-d4608fbcf791 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.373553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ea4cc-91e0-4f5e-98a9-d4608fbcf791 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:06.381356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c62ea4cc-91e0-4f5e-98a9-d4608fbcf791 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 00:50:06.387825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 229/478] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:06.390427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:06.401564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d8da-8c13-4394-8599-dc015ed2bf36 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:06.406483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:06.407143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:06.407434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:06.407715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:06.408601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:06.408940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:06.410661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1257e67-4cb9-4b3e-9a13-c8d7c25c1ac1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:06.421443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 250/479] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:08.438961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf1e8-f882-42a7-94d9-fb13d7c3ab85 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.439470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf1e8-f882-42a7-94d9-fb13d7c3ab85 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.439546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf1e8-f882-42a7-94d9-fb13d7c3ab85 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.441479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 230/480] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:08.452153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81494b5-5553-44ea-ad47-4dfb8df16f46 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.452640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81494b5-5553-44ea-ad47-4dfb8df16f46 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.452746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81494b5-5553-44ea-ad47-4dfb8df16f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.481017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e81494b5-5553-44ea-ad47-4dfb8df16f46 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:08.482342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e81494b5-5553-44ea-ad47-4dfb8df16f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:08.494266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 251/481] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:08.536792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf1e8-f882-42a7-94d9-fb13d7c3ab85 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.553773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf1e8-f882-42a7-94d9-fb13d7c3ab85 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.556215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb2e3-85b6-47b0-b98a-e45bba55335e None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.556499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb2e3-85b6-47b0-b98a-e45bba55335e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.557109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb2e3-85b6-47b0-b98a-e45bba55335e None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.559364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 252/482] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:08.559567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8264f-ee9d-4387-9860-9e900d574b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.560557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8264f-ee9d-4387-9860-9e900d574b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.560846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8264f-ee9d-4387-9860-9e900d574b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.561124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8264f-ee9d-4387-9860-9e900d574b99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.566996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3bfd0-a4e1-40cd-bc1c-8ddefc19174d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.567569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3bfd0-a4e1-40cd-bc1c-8ddefc19174d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.568063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3bfd0-a4e1-40cd-bc1c-8ddefc19174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.580623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8264f-ee9d-4387-9860-9e900d574b99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:08.587907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-58e8264f-ee9d-4387-9860-9e900d574b99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:08.589550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 231/483] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.591476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a9e3bfd0-a4e1-40cd-bc1c-8ddefc19174d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:08.591799 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abfe1-7727-422a-8903-5854741b038a None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.592118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abfe1-7727-422a-8903-5854741b038a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.592408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66abfe1-7727-422a-8903-5854741b038a None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.593556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a9e3bfd0-a4e1-40cd-bc1c-8ddefc19174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:08.594088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 232/484] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:08.598721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66abfe1-7727-422a-8903-5854741b038a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.603814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 253/485] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:08.605311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.606017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.606597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.627482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:08.628460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66abfe1-7727-422a-8903-5854741b038a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.630818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:08.635639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.636355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.636622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.637441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.638590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.638902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.640661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.642179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 254/486] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:08.643192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.656291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0186d3-7217-4008-8d08-74746b39ea16 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.659255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 233/487] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:08.664937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.670314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.671341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.671777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.672226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.677071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205f7f8-a9fa-4c9e-a756-efdff8f9e177 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.682980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.683324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:08.684754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.685352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.685867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.691438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:08.697665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 255/488] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.698083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.698410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.700880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.708767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be8be2-28a1-4690-ba53-719bc2c7b154 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.713576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.714361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.714650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.715453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.724606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:08.731975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 234/489] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.731975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.736483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:08.742414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bad4b-e9f9-4035-9594-f8941fc9e7ff admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.744521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:08.747277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 256/490] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.748490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.750075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.752029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.752525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.753077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.754067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.754725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.757559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.762069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e8a20-bacd-493c-9db6-a78f4e460e24 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.768317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.769127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.769419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.769700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.770808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.771121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.773310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 235/491] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:08.774688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.779123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.788891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6d000-66e3-4b33-b514-af8fe2f6ddb5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.801301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 257/492] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:08.801301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.801582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.801582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.801582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.801582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.802794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.803112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.804759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.814064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 236/493] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:08.814471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afec90e-3876-4b6e-a150-c3136e4bf544 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.814906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.820117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.821231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.821713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.822447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.829753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab4316-47fe-4738-917e-f857d9e1b978 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.835605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.836363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.836575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.836869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.837150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.839559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.847089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.849187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.862287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:08.863631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:08.864457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 258/494] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.864860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 237/495] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.865734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.870168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.877244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ff88a-5889-481e-b185-7cef2b0d67ad admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.881546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d82c15-4dc5-4ea8-a38f-3e6cbc098898 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.883023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.884369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.884988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.885539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.886362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.887272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.887572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.887871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.888609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.892886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.892886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:08.892886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:08.892886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:08.892886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.899798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.902002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.910283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 238/496] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:08.911163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.923402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:08.925072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 259/497] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.933618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001bee8-bc14-4ee8-bb91-6b48e38b73b9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.933743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.935760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.936479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.936765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.937044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.937903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.938205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.939239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:08.939239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:08.939239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:08.939699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190f143-a458-461b-9776-a2fc6947f5bb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.940423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.944921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.945967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.946494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.946985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.956086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:08.958444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:08.974871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 00:50:08.976899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 260/498] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:08.977891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.986730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 239/499] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:08.987395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:08.990027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116753d-bdd5-4ac2-b070-c4b04d830b97 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.995405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:08.996432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:08.997009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:08.997316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b357c7-0b63-4909-b5c9-638c52c414c2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:08.997742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:08.998983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:08.999596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.002123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.002230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.002820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.003109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.003392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.004301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.004615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.006782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.017157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 261/500] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.018332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.029520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c129e1-a641-45cc-b4d7-c9b045648ef0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.030470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 240/501] 10.222.0.91 () {56 vars in 1158 bytes} [Mon Feb 21 00:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.031312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.035288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.036409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.036940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.037418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.045887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0381f-53bc-4c8c-a51c-078be3488115 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.047670 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.050301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.050657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.051476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.051769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.052093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.060667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.062744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.064707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 262/502] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:09.065926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.078688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7257796-5d29-4e6d-84d3-cb8594aa8dd1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.078918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 00:50:09.080178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 241/503] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.080986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.084934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.086065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.086571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.087131 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.097448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.097941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6979-ba93-4383-a3a9-86b83ae57270 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.100395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.103114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.104019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.104305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.104635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.112696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 263/504] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:09.114006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.119228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.121355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.125514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0cb5-28bf-4f9b-9023-b8a5ce825162 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.130791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.131896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.132402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.132890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.134007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.134580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.135864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:09.135864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:09.135864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:09.137930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d2bd-2161-4751-8ff3-facd5a6dad62 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.141979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:09.143241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 242/505] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.144097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.155292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39348ac-9647-4c17-ba8e-477cdf2d53f5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.160043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.160826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.161137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.161414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.172163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.174000 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.183115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 264/506] 10.222.0.91 () {56 vars in 1158 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.185228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706507-e4b7-4e33-9168-d20ae4d34bc7 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.185732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706507-e4b7-4e33-9168-d20ae4d34bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.186215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706507-e4b7-4e33-9168-d20ae4d34bc7 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.188261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 265/507] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:09.189309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706507-e4b7-4e33-9168-d20ae4d34bc7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.191258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:09.196839 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 243/508] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.197657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.203998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706507-e4b7-4e33-9168-d20ae4d34bc7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.207923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b5762-bfe9-4b49-8483-a0e38f69ecc7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.209821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.210633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.211109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.211535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.212434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.212667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.213064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.213308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.213592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.213873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.216019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d432c-1aac-45fc-b485-feb579f279b3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.222451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.224232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.229600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 266/509] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.231520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.232038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.232529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.233280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 244/510] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:09.234311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.243122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f5dc6-3b00-44a0-a380-6ee512b3b36b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.247659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.248335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.248619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.248902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.249608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.249914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.251490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.254326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:09.255721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:09.263591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 245/511] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.264778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 267/512] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:09.265774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.268642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.278918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aab3c-bf10-44e3-9c0c-f96f2c91bea7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.283559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b77b8-dda4-4563-802d-cbb5fc2b7f71 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.290580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.291364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.291473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.291649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.291964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.292203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.292494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.292768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.299542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.301545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.303773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.305627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.315367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:09.321321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 246/513] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.321321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.322000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:09.323264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 268/514] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.327855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.335261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2f56f-861f-4946-9b9b-fdad7a8e9843 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.337574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab557839-fa5c-489b-be56-0cb0fd211b45 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.339716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.341892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.341892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.342100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.343672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.344467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.344753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.345035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.349453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.351408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.358009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:09.365094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:09.371551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 269/515] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.371551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.371760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:09.374109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 247/516] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.374812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.382377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060268fb-db4f-4bfd-a0c2-09412a65d6a1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.384845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce600-d103-49e6-8665-b27900f12785 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.387428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.388099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.388348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.388619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.389402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.389714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.390799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:09.390799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:09.390799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:09.391202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.391872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.391969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.392163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.392441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.393156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.393465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.395030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.410079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 248/517] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.410921 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.413546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 270/518] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.414594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.424820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458986c9-0cee-4f01-831e-9d92ef44f5f8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.425050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf261234-f109-48dd-b7a4-754dd67f57ec admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.429375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.429781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.430011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.430294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.430570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.431169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.431350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.431658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.432009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.432457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.433369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.433564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.434061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.435816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.444427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 249/519] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.450382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 271/520] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.450382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.450655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.457898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658df48-d4fc-4de2-a707-30b10a46eaec admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.461235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4c0fd-dadb-47df-a6d0-ef4362b73c6b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.462574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.463193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.463478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.463741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.464662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=0d58bb9324d548b9b0e5fec7ae458a6a) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.465473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.467314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.467929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.468884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.469360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.469808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.473179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 272/521] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/role_assignments?user.id=0d58bb9324d548b9b0e5fec7ae458a6a&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.477022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.477437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.479643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.489724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c288c7a-14dc-452d-b3ee-8ef5f75467ee admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.494634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.495531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.495921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.496303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.497274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:09.499106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 250/522] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.500397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.514059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc8e80-6252-4e1c-81b8-12d4107a4b3f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.515716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.518490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.519713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.520660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.521179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.521683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.522735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=14e036fb8f904380a1f0d15e085f3948) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.523332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.525548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.533822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 251/523] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/role_assignments?user.id=14e036fb8f904380a1f0d15e085f3948&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.535214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.544931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-9b0bea62-fc21-4cd2-9d40-b0348f4ce32e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:09.546193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 273/524] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.547347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07881d-3495-49bd-9364-1e118a7b22fc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.552692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741096-c425-418c-8aea-7f0c9df08e6a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.553084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741096-c425-418c-8aea-7f0c9df08e6a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.553426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9741096-c425-418c-8aea-7f0c9df08e6a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.556163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 274/525] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:09.556674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.557025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9741096-c425-418c-8aea-7f0c9df08e6a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.557891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.558381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.559679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.560836 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.561438 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.562831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:09.562831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:09.562831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:09.564477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258550ff-fe61-4700-b0d7-2da7fe1fa343 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.571871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9741096-c425-418c-8aea-7f0c9df08e6a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.578445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.579121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.579412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.579719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.581239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.581561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.583327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.591531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 252/526] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.593546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.594132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.594616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.608245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 275/527] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.609058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.621533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:09.623284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:09.626125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece2d9c-0ee2-47aa-85f2-1ba8b5d351c7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.631591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.632311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.632596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.632882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.633683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 253/528] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:09.633818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=7c90c0c26a544e089b126df43151e6f9) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.634108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.635314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.636263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.644341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 276/529] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/role_assignments?user.id=7c90c0c26a544e089b126df43151e6f9&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.646617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b675-5928-4197-a2cd-2a4f8b92bd44 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.656976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.658383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.658971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.659553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.669738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.672505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.686167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.689621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 00:50:09.691255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 254/530] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.700292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.706922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b57d66-99d6-4912-8609-b1c4b9e588b3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.707164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.707957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.708229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.708516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.725513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8391cef-9fed-4a84-b76f-03075b0cf678 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.728946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.732250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.733146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.734094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.734587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.735083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.736200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.736857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.739080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.753481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:09.754803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 277/531] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:09.762965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 255/532] 10.222.0.91 () {56 vars in 1160 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.764780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.779535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.782225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a0c8-56c2-409b-9895-7edc5c288574 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.790102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.790778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.791069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.791352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.792132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.792446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.795076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304fea2-9a63-422e-a766-989977d17c73 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.795348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.801399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.802461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.803693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.804285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.815282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 278/533] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:09.815949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.816665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.818634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.827967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6c00-8c5d-42c2-9f20-c69ab5e6a379 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.831950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 256/534] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:09.837831 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.838536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.838829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.839115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.840070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.842779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.851984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.864193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c3b64-33f1-4413-a01a-b2bfaf2a2039 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.869801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.870620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.870910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.871891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.883884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.885792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.906788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:09.908166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 257/535] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:09.913827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.925546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6275c9e-a907-4b42-9845-07e1e627574e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.930332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.935717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.939377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 279/536] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:09 2022] POST /identity/v3/users => generated 247 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:09.942648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.942648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:09.942648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:09.942648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:09.943125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:09.962194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 258/537] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:09.964532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:09.976301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a4216-7e3d-44d8-b197-fe35aad1dfe7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:09.986116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:09.987031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:09.987369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:09.987656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:10.006884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:10.009004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:10.027607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:10.029278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 280/538] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:10.034968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:10.049393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6917c2f-9e0b-476c-b308-e7bf955cbefe admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:10.061177 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:10.061842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:10.062124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:10.062400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:10.063200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:10.063505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:10.065385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce571a71-78dd-41d1-8367-3dc0f3fe814b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:10.083984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 259/539] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:10.090526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:10.105232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0ecff-5425-478a-ac37-1a79078ad889 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:10.115060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:10.115720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:10.116034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:10.116314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:10.117152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=84fdc361782f47a2976d393a6b5e1397) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:10.117458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:10.119308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc61887-176f-4c69-ae46-2232b808dc54 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:10.128693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 281/540] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:10 2022] GET /identity/v3/role_assignments?user.id=84fdc361782f47a2976d393a6b5e1397&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.468965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458397-1330-4e6f-9280-b13aa58457b2 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.469663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458397-1330-4e6f-9280-b13aa58457b2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.469663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458397-1330-4e6f-9280-b13aa58457b2 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.471521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 260/541] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:12.479425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1cd3b-425e-4f31-850c-a3bbd3ad8eb4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.479425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1cd3b-425e-4f31-850c-a3bbd3ad8eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.479425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1cd3b-425e-4f31-850c-a3bbd3ad8eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.504095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-bce1cd3b-425e-4f31-850c-a3bbd3ad8eb4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:12.505643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bce1cd3b-425e-4f31-850c-a3bbd3ad8eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:12.519007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 282/542] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:12.547882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e333546-4bac-48b3-b902-bb2b7e227144 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.548195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e333546-4bac-48b3-b902-bb2b7e227144 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.548449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e333546-4bac-48b3-b902-bb2b7e227144 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.550498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 261/543] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:12.555896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075131-3c87-4418-bd5a-8c5a4e1bedff None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.556341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e333546-4bac-48b3-b902-bb2b7e227144 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.556793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075131-3c87-4418-bd5a-8c5a4e1bedff None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.557299 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc075131-3c87-4418-bd5a-8c5a4e1bedff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.572611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e333546-4bac-48b3-b902-bb2b7e227144 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.577640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.578419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.578697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.578971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.579403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-fc075131-3c87-4418-bd5a-8c5a4e1bedff None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:12.580873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fc075131-3c87-4418-bd5a-8c5a4e1bedff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:12.589350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 283/544] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:12.590896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:12.591277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1e9a-5aab-450a-980f-5ecf8c884f9a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.591571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1e9a-5aab-450a-980f-5ecf8c884f9a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.591868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1e9a-5aab-450a-980f-5ecf8c884f9a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.593830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 284/545] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:12.601313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.601605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.601892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.603722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:12.606030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 262/546] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.612215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.622501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e502aba-b1ce-456d-8f82-072e5e468946 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.627613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.628576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.629160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.629627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.629981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:12.630798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.631198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:12.631507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.633528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.640256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 285/547] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:12.647880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.650785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af670d9-bdb4-4def-965e-4eeb7d3ef7ed None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.652061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 263/548] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.658889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.665946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.666753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.667038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.667315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.674428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e757e9-cd43-49d7-b572-24d404651c11 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.680802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.681829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.682461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.682985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.683316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:12.691115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:12.692661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 286/549] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.696334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.697981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.698842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.709487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91602e2a-d6c4-443f-83eb-f3006d446135 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.714212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.716344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.716740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.717121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.722419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:12.724905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 264/550] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:12.725824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.735653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:12.737440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182824bd-57ee-4f84-ba91-5a266d3b715c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.742090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.742890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.743222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:12.743468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.743922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.744933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 287/551] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.745232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.750620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.750801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.750801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.763867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116c785-222c-48c7-aac3-c3bb773999fc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.764923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 265/552] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.766056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.774476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.775264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.775647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.776058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.776990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.777592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.779309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d74b-6be3-4192-bc6e-9bd59c6b3a08 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.779514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.784379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.785290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.785715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.786130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.787051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.787499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.789462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.794939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 288/553] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.798996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 266/554] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.799335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.805670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.815034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a1473-84a5-44fb-943d-ff903e3bc243 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.817400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad1c2-d88a-4d33-8b87-d74ba632ba15 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.819755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.820656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.821018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.821303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.823541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.825712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.826232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.826709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.833647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.835753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.838162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.841361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.855105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:12.860879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 289/555] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.860879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.862402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 00:50:12.868331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 267/556] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.869204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.872604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686ba40-e7c1-4ced-9475-023fce989914 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.880424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.881214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.881498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.881783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.882122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03540c16-0cea-4967-ae08-3b88f5d5b463 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.887447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.888136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.888477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.888696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.889512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.889811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.891415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.893479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.895304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.908206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 268/557] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.908206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.914082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23eb81c-f8e0-4f52-aa2f-29c628bb3633 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.917463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-d9cd790d-61a3-4c9f-9afc-5443e76801d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:12.918487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.919296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.919657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 290/558] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.921037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96a42-9e42-4620-bac9-bdf5f288dc5d None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.921397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96a42-9e42-4620-bac9-bdf5f288dc5d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.921745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96a42-9e42-4620-bac9-bdf5f288dc5d None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.925869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.926196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.927069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.927653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.927761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 291/559] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:12.928407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96a42-9e42-4620-bac9-bdf5f288dc5d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.929289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.942937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96a42-9e42-4620-bac9-bdf5f288dc5d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.947464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.948342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.948700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.949565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.954398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 269/560] 10.222.0.91 () {56 vars in 1158 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.954398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:12.962056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.963651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a91623-44f8-425c-b3e4-b4798497beab admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:12.964289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.968979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:12.969616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.969895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.970169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.970892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:12.971189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:12.972950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:12.979879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-efea9bda-b783-43da-94ca-b89cfdec2ccb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:12.981623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 292/561] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:12.982937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:12.983298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:12.983646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:12.993060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 270/562] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:12.993060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.004313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0de9-701a-41d5-80b2-e2b50ca4139f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.007719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:13.009006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:13.010350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.011242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.012276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.012535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.018558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 293/563] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:13.019603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.032335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.034305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.037422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e31283-6ef0-4b72-9e41-a83cc270f1e6 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.042262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.043287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.043755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.044239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.045325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.045822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.048135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.051960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:13.053171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 271/564] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.053947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.064584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac272382-0020-4c01-8a4c-20e3869277a7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.067419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 294/565] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.068309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.072732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.073806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.074773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.075301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.082482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b32dd-f2c4-4db4-8780-fc04f60a0420 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.083905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.086443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.087235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.088046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.088331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.088608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.100221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:13.102306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 00:50:13.104005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 272/566] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.104936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.107682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:13.108905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 295/567] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.109663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.118162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8af35-2a85-47c4-a7e3-ff9c678674d9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.122469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c99f-1a04-4527-9f94-d565d4274b51 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.123502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.124310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.124657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.125058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.125844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.126248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.127494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.128003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.128282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.128570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.128850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.140765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.141288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 273/568] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.142105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.142615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.151632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ad625-2823-467d-8a5e-37057bfa5be8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.156125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.156760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.157044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.157322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.158145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.158453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.159655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:13.160344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02221fc8-34e0-46ab-9c46-4657c307ca10 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.161037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 296/569] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.161633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.172215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad8113-06d1-4dc3-a3f3-4e8f93f8d79d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.176685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.177318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.177571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 274/570] 10.222.0.91 () {56 vars in 1158 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.182439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.182439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.182439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.182695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc9ea-9f68-4f82-a045-209835d64198 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.182777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.182858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc9ea-9f68-4f82-a045-209835d64198 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.182858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffc9ea-9f68-4f82-a045-209835d64198 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.183014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.183093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 275/571] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:13.183093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc9ea-9f68-4f82-a045-209835d64198 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.193200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 297/572] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.194005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.199113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffc9ea-9f68-4f82-a045-209835d64198 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.204392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.204581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46723a-7bfd-488c-8f82-7bdcb5e0f17c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.205152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.205435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.205709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.210227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.210868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.211154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.211435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.212230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.212541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.213160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.214140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.215513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.225759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 298/573] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.226357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.228324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-e14ce188-4542-47cf-a277-97291031b88a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:13.232051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 276/574] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.232051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.232051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.232051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.236858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374992d-a9cd-4dd9-bc57-eeba0cfd1608 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.241237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.241999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.242283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.242558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.251487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:13.252709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:13.253889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.255721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.260366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 277/575] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:13.261120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.271933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bbefb-30a8-4de7-a559-53aace4d44ee None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.275805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:13.276587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.281630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 299/576] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.281761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.281761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.282013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.282101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.291323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db7af6-e80a-4639-bb75-370f47c8bcfe admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.292245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.294293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.295886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.296723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.297009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.297286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.304059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.305995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.311869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:13.313050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 278/577] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.313863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.319862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:13.321026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 300/578] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.321782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.323491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb32a4-04d4-4c2f-94bb-51cd68f4ba4c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.328714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.329348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.329636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.329912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.330694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.331034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.332046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c5d0-9095-452a-81d8-e27158aa1216 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.332885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.336736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.337345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.337628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.337903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.338609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.338912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.341301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.344766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 279/579] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.345540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.359696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7aee7-362d-4f53-9f49-d5bc3a718e23 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.360184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 301/580] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.360843 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.364486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.365265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.365548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.365826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.370041 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8e804-8b3a-4d28-90f2-9ff4af46b80c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.376813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:13.377791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.378439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.378727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.379010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.379774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.380115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.381719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.383740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:13.384979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 280/581] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.385736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.395252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 302/582] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.395915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.397226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cee5b-2d60-4f0d-b4af-34df189726f7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.401955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.402967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.403325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.403615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.404444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.404754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.405853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b0058-02ac-4a25-9844-b48e454b8219 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.406630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.410589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.411522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.411880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.412116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/14e036fb8f904380a1f0d15e085f3948/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.418631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 281/583] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.423341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.427271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=14e036fb8f904380a1f0d15e085f3948, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.428562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939e24a-3745-4c5c-be8c-7793607c63e4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.429946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.432851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.434176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.434860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.435145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.442078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.444042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.457983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:13.459368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 282/584] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.460176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.469561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297130a-45c3-429b-acee-56636b7da887 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.474121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.474744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.475063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.475340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.482598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.482598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.482598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.486631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 283/585] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.487198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.496913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49b81a-46de-42ee-8dfd-1238862cfe64 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.501288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.502157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.502395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.502676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.509010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 303/586] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:13 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/14e036fb8f904380a1f0d15e085f3948/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:13.509814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.510421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.512692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.527860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 00:50:13.529683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 284/587] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.530534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.544940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb67b-66bc-4eb7-b1c5-c2ed998cb5f7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.588954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc2fae-2d69-4e5f-8871-4f06158db740 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.594082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.595077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.595426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.595771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/0d58bb9324d548b9b0e5fec7ae458a6a/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.611059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.612103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.612533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.612965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.613920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.614060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=0d58bb9324d548b9b0e5fec7ae458a6a, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.614233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.616108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.617010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.637273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 285/588] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.637273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.640747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bdabc-caa9-4183-8e74-af7d95c5990d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.647723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.648607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.648892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.649167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.660817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.663544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.680418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:13.681659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 286/589] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.682432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.694452 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71007c4f-73cf-46b1-8642-f5862148dc65 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.703066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.703732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.704050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.704332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.705219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.705485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.706979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 304/590] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:13 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/0d58bb9324d548b9b0e5fec7ae458a6a/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:13.707313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.708763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.728325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 287/591] 10.222.0.91 () {56 vars in 1160 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.729289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.741792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275ec8b-31fb-42cb-bc67-87cc8a958dc0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.806470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.807149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.807433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.807712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.809047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.809356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.810238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032c7ae-b319-4b66-be21-57181636e217 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.811109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.816182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.817091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.817427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.817719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/7c90c0c26a544e089b126df43151e6f9/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.824217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 288/592] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.825244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.842711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe67a7-c46a-4367-8a1f-fb1eaa538ee5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.846247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=7c90c0c26a544e089b126df43151e6f9, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.847781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.848681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.848965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.849145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.849251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.862719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.864653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.882944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:13.890261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 289/593] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.890261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.900982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2650dc5-59b8-4372-afa6-6c715eec777d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.907262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.908158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.908452 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.908736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.918366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.920535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.934741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 00:50:13.936141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 290/594] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:13.936786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.946657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27dd14-0d06-45c1-b7a0-762077ca58d1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.952031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:13.952677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:13.952961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:13.953241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:13.954006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:13.954312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:13.955908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:13.968488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 291/595] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:13.969291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:13.978884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da705b91-3333-4612-bf8d-6fa1c8b583e3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:13.982868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 305/596] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:13 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/7c90c0c26a544e089b126df43151e6f9/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:13.983999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.049868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.050805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.051149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.051489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.052511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:14.052907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.055044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.059310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ceb89-c8c7-4f6d-8049-941f705cc7e6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.064475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.065476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.065768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.066050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.075534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.077837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.082775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 292/597] 10.222.0.91 () {56 vars in 1156 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:14.084382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.094132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24394d-497f-464e-ba92-a8b647559ba7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.096163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:14.098245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 306/598] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:14.103336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.107996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.107996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.107996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.109748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.118136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.120341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.130035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bad6ff-e7dc-4243-ac94-63ddd9d82aa2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.135986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 293/599] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 00:50:14.138480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.148912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728b85d-af52-4882-93ec-bf2830df1e23 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.152123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.153247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.153537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.153819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.154730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:14.155046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.155638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.156768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.156956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.157488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.157958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.179196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.181484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.190050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 307/600] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:14.191728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.203151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1023a50-0d91-4658-8bd2-adf2300b6ae4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.208634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.210173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.210727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.211208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/84fdc361782f47a2976d393a6b5e1397/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.228627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=84fdc361782f47a2976d393a6b5e1397, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.229919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:14.232832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.240174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 294/601] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:14.242094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.257345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776aae0-9a76-4a6d-83b5-42948697cbf0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.264040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.264702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.264985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.265266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.265998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:14.266305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.268005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.280732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 295/602] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:14.286418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.297211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da0616-4248-4936-9e2f-df2ee9f4b289 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.302362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.303355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.303687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.307696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.313050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.315297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.316847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 308/603] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:14 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/84fdc361782f47a2976d393a6b5e1397/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:50:14.330261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:14.331875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 296/604] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:14.337585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.407343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212def1-b89f-47c6-9c34-ab8f7a58f71d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.418931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.419665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.419982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.420266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.421076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:14.421388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.423258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846358af-40ef-441d-881c-7489992b4ae7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.445983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 309/605] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:14.452340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:14.469618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352720e7-c4e6-4980-89e4-4fa721620965 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:14.480823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:14.481495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:14.481781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:14.482059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:14.482906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=bde8ac2fb5804342b943a6999b23fedd) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:14.483221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:14.485150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90503ca-e251-4be0-9ffa-735dce1e3c20 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:14.493744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 297/606] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:14 2022] GET /identity/v3/role_assignments?user.id=bde8ac2fb5804342b943a6999b23fedd&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:16.448245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f9a0-d0f5-4220-9c31-f7d869a44a78 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.449791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f9a0-d0f5-4220-9c31-f7d869a44a78 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.450275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f9a0-d0f5-4220-9c31-f7d869a44a78 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.452767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 310/607] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:16.459221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.459729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.459804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.486384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:16.487591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:16.499630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 298/608] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:16.537708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f9a0-d0f5-4220-9c31-f7d869a44a78 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.555465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295f9a0-d0f5-4220-9c31-f7d869a44a78 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.561866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f0812-4795-4ff0-81b9-9db34fb6a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.562658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f0812-4795-4ff0-81b9-9db34fb6a6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.562943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f0812-4795-4ff0-81b9-9db34fb6a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.563222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f0812-4795-4ff0-81b9-9db34fb6a6c0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.580769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f0812-4795-4ff0-81b9-9db34fb6a6c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:16.587997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-218f0812-4795-4ff0-81b9-9db34fb6a6c0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:16.590255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 311/609] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:16.596060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.607847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a57de-bb54-426e-872f-6e83fabfe8b0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.612160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a55da-39e1-46a5-a6b7-18c71577ee5a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.612160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a55da-39e1-46a5-a6b7-18c71577ee5a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.612160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a55da-39e1-46a5-a6b7-18c71577ee5a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.612160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 312/610] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:16.617147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.617438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.617721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.623871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.624572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.624856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.625130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.625890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:16.626191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.627784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.646365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:16.647583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:16.651711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 299/611] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:16.657972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.671155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1aa95-428c-418b-8d11-96717252b90f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.675177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 313/612] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:16.678811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.679863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.680355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.680863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.693664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.695801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.711740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.721479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:16.725203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95690-978a-4a64-a2f9-462c7c26631b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.727216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 300/613] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:16.733192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.734392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.738094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.738094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.738094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.752349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5bf5d-9e70-46d0-ae91-0a3b0aa1791a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.763029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:16.768576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.772399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.772399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.772399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.772399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:16.772399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.772746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:16.772828 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.773655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 314/614] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:16.780782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.790681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 301/615] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:16.796737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.802479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad3091-8812-47a8-9e73-45d796b2678e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.807465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee87e9-1a22-476d-9906-91d2b9821db0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.813702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.815040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.815535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.816062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.824836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.825525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.825834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.826010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.826111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.826830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] RBAC: Adding query filter params (name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:16.827137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.828760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.829010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.845758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 00:50:16.849318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 315/616] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:16.851163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 302/617] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:16.856369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.867322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.870008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dae3a6-edc7-401c-9117-d042592761be admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.881583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eaca96-f34a-478b-bfab-1999614017d9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.887065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.887817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.888235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.888521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.888801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.889417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.889917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.890437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.891493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:16.892048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.894157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.913663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 303/618] 10.222.0.91 () {56 vars in 1158 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:16.920959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.920959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.922244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.932437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046bce3-ce73-4fb3-93ad-4be4a948bdfc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.945768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:16.946766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:16.947275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:16.947787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:16.960489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:16.962049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 316/619] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:16.964885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:16.967467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:16.968627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:16.985935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984089a-0143-45b1-abed-e43075a1c45f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:16.989229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 304/620] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:16.994929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.000239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.001330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.001823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.002327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.003514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.004064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.006989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4aa71-09e6-40ee-85c6-19a562f42c9e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.009948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d96c6-927d-4ae8-b873-ca49c885abc5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.016822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.017630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.017918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.018199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.024550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 317/621] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.027744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7cb87-5d40-4f8c-9a61-a4bac71ebdec None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.028910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7cb87-5d40-4f8c-9a61-a4bac71ebdec None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.029400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7cb87-5d40-4f8c-9a61-a4bac71ebdec None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.031689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 318/622] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:17.033608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7cb87-5d40-4f8c-9a61-a4bac71ebdec None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.037705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.039527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.050684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7cb87-5d40-4f8c-9a61-a4bac71ebdec None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.055779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.056827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.057371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.057864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.058922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-6079acae-add0-4e1a-a169-461246eeff26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:17.060319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 305/623] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.061682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.066582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.066948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.069244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.071286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.088144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:17.089829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:17.092183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:17.093997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 319/624] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.095101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.104583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 306/625] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:17.107986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.116074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc348-ad0d-42fb-8a08-1dec1a1ce08f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.125477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8386c-6b6f-4369-9718-085fbcc07dfb None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.126869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.127758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.128294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.129444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.130872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.131678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.134202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.135224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.136077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.136510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.137478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.138481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.138912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.140932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.154653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 320/626] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.155759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.165313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 307/627] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.165313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.172123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568baa5-20ed-47bd-aec6-95adacae6521 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.176073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52a919-238a-44c8-8798-b35c95211c94 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.177654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.178960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.179575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.180199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.180934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.181818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.182203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.182588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.190578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.192725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.193283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:17.201801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:17.203535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 321/628] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.208144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:17.209366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.213972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 308/629] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.216182 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.221452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d81ae-2613-478d-8410-e98cac0c24e7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.226317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de44f1-2a42-44f6-92b1-c76b144d25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.227178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de44f1-2a42-44f6-92b1-c76b144d25b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.227607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de44f1-2a42-44f6-92b1-c76b144d25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.228089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de44f1-2a42-44f6-92b1-c76b144d25b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.228679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838d7cd-045a-4687-8597-72b798462575 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.233931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.234698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.235112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.235490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.236405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.236815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.237477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de44f1-2a42-44f6-92b1-c76b144d25b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.238587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.239207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de44f1-2a42-44f6-92b1-c76b144d25b0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.247903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 309/630] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.248944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.251298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 322/631] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:17.252844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ceb5e-8303-44de-ba0d-c7bb5fe47756 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.253130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ceb5e-8303-44de-ba0d-c7bb5fe47756 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.253408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ceb5e-8303-44de-ba0d-c7bb5fe47756 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.255244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 323/632] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:17.256658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ceb5e-8303-44de-ba0d-c7bb5fe47756 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.266838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc5874-39e4-4b42-9538-5740a503d7b1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.271455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.271823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ceb5e-8303-44de-ba0d-c7bb5fe47756 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.272126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.272413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.272692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.273482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.273918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.275750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5848c-9041-47c7-a817-02fe456d029d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.277888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.278861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.279290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.279739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.288944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 310/633] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.290470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.290767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.291047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.295083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.297313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.312285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:17.313475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:17.316085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:17.321966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 324/634] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.321966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.325364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 311/635] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:17.328671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.334520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4ecc0-10ee-4d96-8248-0e23747117a7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.339103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910083f-b95a-44ed-86a7-151fb9928d3c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.340329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.341472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.342150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.342657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.344942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.345587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.345877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.346159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.347042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=14e036fb8f904380a1f0d15e085f3948) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.347297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.349184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.356157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.358868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.358977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 312/636] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/role_assignments?user.id=14e036fb8f904380a1f0d15e085f3948&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.359728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.374432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d686f-38f1-4d4a-a3e0-082196f403f2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.379445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:17.379627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.380396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.380685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.380967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.381563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 325/637] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.382155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.382392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.382516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.384319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e2fc3-c836-42e2-b137-1b36c027bac9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.393874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c358560-12db-4abc-9d32-8592d1737d04 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.398640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 313/638] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.399967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871fca-59cc-474c-875d-b1132ff1455c None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.400266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871fca-59cc-474c-875d-b1132ff1455c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.400540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0871fca-59cc-474c-875d-b1132ff1455c None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.403146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 314/639] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:17.403641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.404536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871fca-59cc-474c-875d-b1132ff1455c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.404671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.404826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.405109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.416717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:17.423113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0871fca-59cc-474c-875d-b1132ff1455c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.424253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:17.425715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 326/640] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.426285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.427967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.428731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.429116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.429526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.430451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.430755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.432547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0b6b9-9406-47ec-87ed-3be0d7c41aa6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.436390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d6b51-10c5-46bd-9532-098a89334e06 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.441193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.441814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.442094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.442364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.446567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 315/641] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.452052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.453375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.453785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.454111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.454228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.470326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 00:50:17.471815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 327/642] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.473666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:17.475059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:17.475350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.485977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c36190-c6c5-40e2-a079-6f8efe76ba16 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.487982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 316/643] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:17.489647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.490498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.491168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.491449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.491724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.492603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.492913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.494528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.502835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19927c-810b-4ab8-a81b-fa6a02f54576 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.505463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 328/644] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.506455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.508791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.509796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.510233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.510671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.517346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212718-b197-458f-9dcc-0162d0a97974 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.521453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.522235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.522899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.523179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.523430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.523530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.524316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.524626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.526498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.539192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:17.545563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 317/645] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.545563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.550203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 329/646] 10.222.0.91 () {56 vars in 1158 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.555112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.555683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456af12-6b44-49c7-990c-9b0c3768c8ae admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.560566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.561380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.561626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.561910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.565130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243d411-c86e-4412-b1f5-e9f80a65316e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.569869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.570661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.570940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.571213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.573375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:17.581373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:17.582629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 318/647] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.583412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.583616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.585847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.595273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c74841-10ec-487c-bc0d-bf585397be1a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.600476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.601149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.601480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.601717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.602500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.602808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.604060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:17.604677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.605318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 330/648] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.607327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.616947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11486942-dc33-40f3-8963-3e9a4beb1f71 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.619192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 319/649] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.620081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.624851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.625804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.626093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.626604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.631328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca75ac-7796-4cd2-90c2-37b47034d93c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.635034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.637542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.638284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.638485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.638710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.638982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.640117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.640117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.641638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.647097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 331/650] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:17.647925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.655473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 320/651] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.655473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.657675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422422eb-7be8-43c9-b843-5944b7e28e2c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.663243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a0966-e563-4cea-ae56-02bdaad4697d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.664116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.664768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.665048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.665326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.666050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.666359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.668086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.668989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.669876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.669876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.670170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.671001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=0d58bb9324d548b9b0e5fec7ae458a6a) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.671309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.673322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.680318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 321/652] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/role_assignments?user.id=0d58bb9324d548b9b0e5fec7ae458a6a&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.680714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 332/653] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.681638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.681912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.693672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab96b2-022f-4a97-9464-336e1486ad7e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.696145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3472-43b8-4411-be25-19c71f12d5b2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.699709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.700690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.701067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.701480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.703420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.704526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.705012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.705362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.717242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.718312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.719557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.721347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.739672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:17.740690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:17.741270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 322/654] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.742306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.742675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 333/655] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.749247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.759208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34fef0-ab52-405d-83c2-8fdd8e69aa15 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.764229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c903c1-30f6-4457-b9ed-7eafe911e2bf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.764642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.765708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.765996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.766272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.770626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.772147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.772890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.775992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.775992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.776160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.776236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.778189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.779569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.794041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 00:50:17.795672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 323/656] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.796623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.801778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 334/657] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.802959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.806868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28384dc-db74-4943-9c62-941c3b822d29 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.811911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.812587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.812873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.813154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.813898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.814237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.815881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.817279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefd94b-106b-4fb4-8533-171371e15bb6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.822641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.823890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.825003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.825519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.826780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.827342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.829681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.829819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 324/658] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.834866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.845360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98855c-f07b-444e-998d-3b154ac73aa3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.850029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.850827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.851113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.851398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.860560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.862177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 335/659] 10.222.0.91 () {56 vars in 1160 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.862598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.863791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.875448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d917038-f7c4-459b-8f83-78acf06e3eac admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.877994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 00:50:17.879538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 325/660] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.880454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.881697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.882716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.883232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.883788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.894044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0e2e-0db6-4389-98e1-d365b727da56 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.894366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.898077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.900804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.901444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.901729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.902213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.912580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.914131 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:17.914323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.915963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 336/661] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:17.916882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.925327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 326/662] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:17.926158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.934531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969b10b-322f-4886-9a81-319f2d083d5b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.936610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e63b17-add5-4f36-97ea-aa45897a0f6c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.940219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.941070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.941358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.941543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.941651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.942166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.942477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.942581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.942753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.942846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.943540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:17.943887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.944733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.946490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:17.963678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 327/663] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.967931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 337/664] 10.222.0.91 () {56 vars in 1156 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:17.968055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.969349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:17.975799 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a73e-0d6f-4e25-87ad-7632ac5d0373 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.980459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126130e3-4513-435f-ad5a-0bd8276d292e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:17.981207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.982056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.982459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.982738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.986327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:17.987170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:17.987571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:17.987986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:17.995652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:17.998121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.000203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.002161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.019266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:18.020547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:18.021281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 328/665] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:18.022184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 338/666] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:18.023759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.027723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.036904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ff4d8-bc53-43ce-b3ef-704393943a93 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.039070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f7cb1-5aca-4be6-8095-3793e2a61a58 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.041957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.042629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.043065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.043640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.044308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.044585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=7c90c0c26a544e089b126df43151e6f9) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:18.044895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.045253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.045628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.046000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.046736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.046895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:18.047294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.049244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.053669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 329/667] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/role_assignments?user.id=7c90c0c26a544e089b126df43151e6f9&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:18.054402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.062551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 339/668] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:18.068601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.073186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f52e1-88d0-42db-b31b-d70491e02ab2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.082666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.082890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d355f96-5599-46ff-b309-f20ef6e919d2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.084109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.084585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.085102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.086082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:18.086544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.088786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.090492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.091787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.092007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.092409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.102181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.104538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.110052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 330/669] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:18.112627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.126296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e21ec6-2891-4579-bf70-f89638130f17 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.131404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:18.133188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 340/670] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:18.139988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.146549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.147538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.147998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.149475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.161675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406624e-a077-4b42-a3cc-3659878c247f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.166827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.167005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.167986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.168392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.168816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.169353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.169951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:18.170413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.172613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.183303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:18.185441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 331/671] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:18.185557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 341/672] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:18.191066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.193000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.204089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba20527-3e39-42d3-a369-80ace4dbde4a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.209331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e4a56-c5ed-44b3-9021-7a2d0ca042dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.210210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e4a56-c5ed-44b3-9021-7a2d0ca042dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.210490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e4a56-c5ed-44b3-9021-7a2d0ca042dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.210767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e4a56-c5ed-44b3-9021-7a2d0ca042dd admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/bde8ac2fb5804342b943a6999b23fedd/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.210886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f5a41-a242-4b19-8cd3-a2594a0408fd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.226706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.227385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.227674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.227984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.228906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:18.229220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.232265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.245357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e4a56-c5ed-44b3-9021-7a2d0ca042dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=bde8ac2fb5804342b943a6999b23fedd, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.249144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e4a56-c5ed-44b3-9021-7a2d0ca042dd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.257465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 342/673] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:18.265025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:18.278849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2f55a-93ae-400d-99ae-99f26181b898 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:18.284232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:18.285212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:18.285729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:18.286288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:18.287348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=84fdc361782f47a2976d393a6b5e1397) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:18.287952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:18.290067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7475b-a33b-446e-a227-5a8a7d5aa576 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:18.303984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 343/674] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:18 2022] GET /identity/v3/role_assignments?user.id=84fdc361782f47a2976d393a6b5e1397&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:18.345379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 332/675] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:18 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/bde8ac2fb5804342b943a6999b23fedd/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:20.112768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900ac3-bfcc-426f-a4ec-0c929b827a22 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.113711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900ac3-bfcc-426f-a4ec-0c929b827a22 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.114144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900ac3-bfcc-426f-a4ec-0c929b827a22 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.116317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 344/676] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:20.122340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.123136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.123568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.144108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:20.145491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:20.217867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 333/677] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:20.243553 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900ac3-bfcc-426f-a4ec-0c929b827a22 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.256695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900ac3-bfcc-426f-a4ec-0c929b827a22 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.261183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.262127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.262533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.262907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.273949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:20.276038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:20.293973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:20.299986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 345/678] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:20.301389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.311673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c472b8-c086-4b0e-afbc-cf1cef9c1fc4 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.316513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.317341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.317722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.318093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.318914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:20.319317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:20.321092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a14b-d81d-4f20-82b6-8c502d254b1e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:20.341139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 334/679] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:20.346689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.357514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8c377-a745-492a-b544-7cf78c895a4f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.366325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c113ac-f660-4a84-b800-20e17dcc46cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.366931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c113ac-f660-4a84-b800-20e17dcc46cf admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.367214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c113ac-f660-4a84-b800-20e17dcc46cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.367493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c113ac-f660-4a84-b800-20e17dcc46cf admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.368253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c113ac-f660-4a84-b800-20e17dcc46cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:20.370163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c113ac-f660-4a84-b800-20e17dcc46cf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:20.469568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 346/680] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:20 2022] POST /identity/v3/users => generated 254 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:20.712112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6685f8-0f78-4001-af3b-fd2888e9ce4b None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.712462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6685f8-0f78-4001-af3b-fd2888e9ce4b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.712662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6685f8-0f78-4001-af3b-fd2888e9ce4b None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.714781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 335/681] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:20.720433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.720723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.720997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.742314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:20.743869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:20.759074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 347/682] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:20.784961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6685f8-0f78-4001-af3b-fd2888e9ce4b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.802159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6685f8-0f78-4001-af3b-fd2888e9ce4b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.807308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.808642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.808920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.809457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.822477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:20.830009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:20.831538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 336/683] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:20.838619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.850185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88a968-c8ee-437c-91c6-46fce7e492f7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.858525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.859203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.859488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.859765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.860590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:20.860899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:20.862505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:20.880151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 348/684] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:20.885872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.901441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96597ebd-f53e-4426-91ad-b9da0006085d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.909031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.910008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.910293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.910567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.928340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:20.930178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:20.949297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:20.951070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 337/685] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:20.956424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:20.973205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd635a7-a1d4-4f7c-b31f-b737f9757417 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:20.984146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:20.985043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:20.985479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:20.985922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:20.986810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:20.987270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:20.993166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a880106-e1ea-45e8-a693-15159322a43f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.012969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 349/686] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.018702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.035251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d150825-9169-45c1-be50-b115abf00982 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.044463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.045371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.045658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.045934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.057888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.060245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.077870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:21.079394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 338/687] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:21.080999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177387-fae2-4270-9205-959591e8287a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.081390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177387-fae2-4270-9205-959591e8287a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.081746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177387-fae2-4270-9205-959591e8287a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.084068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 350/688] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:21.085719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.089850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.090216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.090607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.099532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a00fc8-c93b-4bf7-8092-44c2f735fdc6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.112872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.113650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.113939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.114215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.115050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.115361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.117218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.124643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:21.125862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:21.144285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 351/689] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:21.149669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.152565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 339/690] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.164819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352e57b-34e4-456b-b4de-2a6bc9781a85 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.171946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.174754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.175657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.176194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.176679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.186221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdc802-e9a2-4d60-a737-f7a8d8627da9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.189537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.191549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.200204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.201288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.201789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.202280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.204179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.205434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:21.205434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:21.205434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:21.207775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.211938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 352/691] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:21.218240 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.224840 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 00:50:21.226477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 340/692] 10.222.0.91 () {56 vars in 1150 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:21.231998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe81e35-6603-4e1a-a211-bbd93b74ddf9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.233460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.243254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.244523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.247565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.248098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.254598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24fc40-3e94-402f-b7a3-d22e0f58859f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.264653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.266469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.267136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.268189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.268680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.269606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.271947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.273206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:21.273206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:21.273206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:21.273963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.275490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.286893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 341/693] 10.222.0.91 () {56 vars in 1145 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.296806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.300903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:21.302418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 353/694] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:21.307367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe929d-3eee-456a-b70c-a689c2e5b776 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.307750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.322005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba45bcb-dbd8-4275-918a-ea260292fe5f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.325464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.326526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.327003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.327574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.328085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.328735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.328905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.329258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.329583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.329700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.330485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.330909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.331930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.332789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19a9ea-0647-4a66-aa6d-53420ed1e247 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.347011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 354/696] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:21.347185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 342/696] 10.222.0.91 () {56 vars in 1145 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.352308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.358849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff74fe-5e9e-4e6b-97d8-125f215e55e2 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.359222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff74fe-5e9e-4e6b-97d8-125f215e55e2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.359540 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff74fe-5e9e-4e6b-97d8-125f215e55e2 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.363862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 355/697] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:21.367317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.367602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.367905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.375963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27675de0-5e3b-4123-b7ae-4298c0772fe9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.389535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.390388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.390670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.390946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.401273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:21.404637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:21.415273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.421171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.423373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 356/698] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:21.442239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:21.448955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 343/699] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:21.454798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.466430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b668af6-3f80-41e0-aaa2-2649bf325dcf None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.476298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.476999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.477279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.477551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.478402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.478708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.481665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.500548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 357/700] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.503898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.514713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998d38d-aa2e-41bb-8de5-0858b7562fc6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.516350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.528667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad42feb-f0ed-428a-96f0-bdc7934d3115 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.535860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.535860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.535860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.535860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.539992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.540903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.541410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.541889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.543563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=0d58bb9324d548b9b0e5fec7ae458a6a) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.544118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.545710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:21.546451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd7f7b-7433-4386-8f4f-e177e36961a3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.556419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:21.556419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 344/701] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:21.560783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 358/702] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/role_assignments?user.id=0d58bb9324d548b9b0e5fec7ae458a6a&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.560912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.578460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b529b7-b3a3-4345-9e74-fcb529e2324d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.584642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.585329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.585611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.585888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.586647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.586950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.588720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c44c8-142c-4275-841b-8dd6a406a668 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.596428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d78b-d7f2-4e06-ac5e-e9a7c6c019a5 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.596763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d78b-d7f2-4e06-ac5e-e9a7c6c019a5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.596993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d78b-d7f2-4e06-ac5e-e9a7c6c019a5 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.603319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 359/703] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:21.604356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 345/704] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:21.604575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d78b-d7f2-4e06-ac5e-e9a7c6c019a5 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.606872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.607252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.607537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.620228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d78b-d7f2-4e06-ac5e-e9a7c6c019a5 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.625387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.626266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.626551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.626828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.628383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:21.629635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:21.638626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 346/705] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 00:50:21.644022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.644872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.663773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.670078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:21.671788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 360/706] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:21.674348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42b19b-ec8e-4bee-b160-4c5b95ca2fa3 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.678857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.681343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.682216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.682496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.682766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] PATH_INFO: `/v3/services/network` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.684023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.685874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.696235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368ed06-3fdd-45f4-ae59-5e03f87eab3c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.698221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 00:50:21.700935 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 347/707] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/services/network => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:21.705723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.706520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.707114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.707632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.708208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.709510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.710021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.712072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.718100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730715a1-ef40-45c5-8540-16c68171f59b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.723360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.724584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.725078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.725563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.726569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.727122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.729046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.735721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 361/708] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:21.738364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.740830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 348/709] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:21.747627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.750393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2239-f722-40cd-af13-5a241d4c2e20 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.759039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640b67-8275-4d61-86b1-eec48c780f55 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.765339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.765522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.766150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.766439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.766718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.767238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.767717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.768239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.769240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] RBAC: Adding query filter params (type=network) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.769795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.771638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.774920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.777665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.784161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 349/710] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.792883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 00:50:21.794192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 362/711] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:21.800460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.811371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a046f2-69d5-4c41-9ef2-79d0fcdef65e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.816730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.817719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.818149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.818569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.819767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:21.820281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.822393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.847996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 350/712] 10.222.0.91 () {56 vars in 1156 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:21.850760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.861460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf81e1-ed01-4e48-978d-a400f6adb368 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.866648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.867594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.868055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.868533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.879342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.881480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.897033 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 363/713] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:21.900272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.918087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb23c0b-6114-4562-8f97-841923af28d4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.926928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.928090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.928626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.929102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:21.947096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:21.950289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:21.973653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:21.980493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 351/714] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:21.982168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:21.992584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86e2c-8631-4a6e-a05e-b37d26301998 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:21.997967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:21.998722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:21.999103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:21.999450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:22.000406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:22.000788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:22.002520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:22.015452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 364/715] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:22.021175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:22.034454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb3537-795f-4941-9543-317f60eadd6b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:22.039553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:22.040672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:22.041181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:22.041655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:22.051955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:22.054242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:22.068784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:22.070401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 352/716] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:22.076888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:22.089007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f20058-3557-4791-ae80-356047a1a6a7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:22.095274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:22.096316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:22.096801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:22.097388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:22.098487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:22.099014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:22.101146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38f006-fab9-45ca-8dbf-e5762d8470c3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:22.120033 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 365/717] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:22.122217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:22.134829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949a307-171b-403b-8293-24ea550b0e51 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:22.140115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:22.141085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:22.141590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:22.142083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:22.143131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=bde8ac2fb5804342b943a6999b23fedd) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:22.143712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:22.145949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4b833-bbec-4a45-8d1c-3467b634d43e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:22.155989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 353/718] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:22 2022] GET /identity/v3/role_assignments?user.id=bde8ac2fb5804342b943a6999b23fedd&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:23.588991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec08fa-fe3c-4eb7-a251-2f6bbe0bc129 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.590148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec08fa-fe3c-4eb7-a251-2f6bbe0bc129 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.590148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec08fa-fe3c-4eb7-a251-2f6bbe0bc129 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.592099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 366/719] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:23.597728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.598275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.598275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.624973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:23.626096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:23.634280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 354/720] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:23.674527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec08fa-fe3c-4eb7-a251-2f6bbe0bc129 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:23.693819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec08fa-fe3c-4eb7-a251-2f6bbe0bc129 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:23.700635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:23.701831 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.702329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.702848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.719474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:23.728902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:23.731399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 367/721] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:23.740051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:23.759421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634b2e-1d50-43d8-8b48-6a563be3e1ca None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:23.773326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:23.774002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.774283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.774556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.775344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:23.775620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:23.777272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:23.790195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 355/722] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:23.795406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:23.809422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f63dd-52fb-472b-ad77-8e05933a6092 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:23.820176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:23.821257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.821762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.822236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.843736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:23.845935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:23.867107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:23.868660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 368/723] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:23.874698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:23.894315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04612230-7423-4337-b3c4-df6cd66a9ddc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:23.902925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:23.903587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.903888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.904176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.904906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:23.905210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:23.906807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:23.929461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 356/724] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:23.935371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:23.947940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cfeed-0a28-405a-91da-9d0c10a99228 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:23.953683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:23.954759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:23.955254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:23.955727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:23.965199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:23.967557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:23.983013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 00:50:23.984955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 369/725] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:50:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:23.991019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.005139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871445a-0eed-40b1-93b6-c8519bbfdf40 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.015638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.016357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.016639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.016914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.017762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.018067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.019928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfec80-5d22-4e1f-bf24-529ac89c27e8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.056065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 357/726] 10.222.0.91 () {56 vars in 1170 bytes} [Mon Feb 21 00:50:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:24.062587 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.077452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2c396-6f9c-44fa-ac24-b7a03c57be0e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.086940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4e93-fac3-43b6-88b6-d5dd3fbb0c4e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.087269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4e93-fac3-43b6-88b6-d5dd3fbb0c4e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.087506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b4e93-fac3-43b6-88b6-d5dd3fbb0c4e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.089765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 358/727] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:24.094324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.094998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.095287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.095567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.096292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.096680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.097096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.111786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.113787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.121551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:24.124500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:24.132759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 370/728] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 00:50:24.134507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 359/729] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 00:50:24.140904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.158200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.158833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142591e1-9daf-4ae2-b510-d8c1f5bdf11b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.168004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a5e7-db82-4200-a2cc-4d7c6b6cbf22 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.172807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.173463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.173755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.174014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.174781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.175807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:24.175807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:24.175807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:24.176745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.180591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.181421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.181749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.182028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.196444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.198988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.217689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:24.219054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 371/730] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:24.224631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.235638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16643-0d7e-4d9b-afd7-ee6dd3713be8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.240648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.241509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.242086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.242579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.243564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.244106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.246624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.260293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 372/731] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:24.266055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.276361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb81389-7e2b-47e5-a3f2-dbbf13c97923 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.281488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.282555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.283077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.283603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.291479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.294538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.308917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:24.310880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 373/732] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:24.316597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.317302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 360/733] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:24 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:24.336036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9c11d-5e6f-42f3-a755-4f2cb811e1f0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.373495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.374177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.374488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.374771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.375582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.375938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.378118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28101d3c-2ec8-4cda-afe0-226093fe6e35 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.402632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 374/734] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:24.409255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.437179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587c485-94c2-4388-a854-8b47363f2b5e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.446026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.446690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.446968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.447242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.448111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=70eaa9515db94bc99055f1f8db7890ea) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.448460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.450314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbaca4-5ece-4e38-a6b0-4b4a85214ff1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.456958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 361/735] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/role_assignments?user.id=70eaa9515db94bc99055f1f8db7890ea&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:24.472576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f27c-a06e-453c-a671-97d717c2f249 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.472920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f27c-a06e-453c-a671-97d717c2f249 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.473150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f27c-a06e-453c-a671-97d717c2f249 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.475020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 375/736] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:24.500852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046c3b-ad03-429d-a53e-3ee8dac16435 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.501177 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046c3b-ad03-429d-a53e-3ee8dac16435 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.501418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d046c3b-ad03-429d-a53e-3ee8dac16435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.521623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7d046c3b-ad03-429d-a53e-3ee8dac16435 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:24.522952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7d046c3b-ad03-429d-a53e-3ee8dac16435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:24.532287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 362/737] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:24 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:24.556143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f27c-a06e-453c-a671-97d717c2f249 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.564449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa1f1-205e-443b-9219-5f3771ed61bc None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.564761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa1f1-205e-443b-9219-5f3771ed61bc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.565000 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa1f1-205e-443b-9219-5f3771ed61bc None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.567145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 363/738] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:24.572878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.573174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.574023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.577157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f27c-a06e-453c-a671-97d717c2f249 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.584111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.584840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.585127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.585406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.586393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.587419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:24.587419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:24.587419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:24.588359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.595060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:24.596498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:24.605434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 364/739] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:24 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:24.628932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.638735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c309f4-c711-4e69-af8d-3bf475f6e628 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.643692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.644807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.645296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.645767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.664269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:24.672841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:24.674720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 365/740] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:24.687119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 376/741] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:24 2022] POST /identity/v3/services => generated 240 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:24.687618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.699750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff6cc0-2656-43ac-a271-345426836205 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.727943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.728841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.729205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.729638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.730522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.730895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.732847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.744224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 366/742] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:24.753019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.765906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba4af-6044-43e9-a6fe-f556f772c21d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.771556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.779000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.779875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.780302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.794254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.796615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.822363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:24.829476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 377/743] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:24.835760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.857157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b05ec7-096c-442d-a2b2-0cd23e372ed4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.867278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.868173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.868563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.868948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.869792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.870797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.873080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.894835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 367/744] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:24.900522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.915922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2eb662-2147-49a7-80da-bb42b7b1dafa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.921092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.922099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.922644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.923060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.932002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.934536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:24.949274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:24.951076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 378/745] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:24.956500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:24.967552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79f34f-15a6-4a31-9286-f91cf6b1466c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:24.979253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:24.980632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:24.980918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:24.981358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:24.982200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:24.982508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:24.984422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:25.011212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 368/746] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:25.012383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:25.025391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19937cf7-eeee-4e3a-8920-b0dfe28b7c90 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:25.030510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:25.031513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.031999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.032414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.045814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:25.047889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:25.071350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:25.077526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 379/747] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:25.078858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:25.094226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e90da-4f35-4828-86d7-2a4724403ae6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:25.109383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:25.110135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.110493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.110930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.111868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:25.112291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:25.114044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:25.133740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 369/748] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:25.140102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:25.156087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0668f-bed2-4fc2-bcfe-c86db103fa5c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:25.164134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:25.165133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.165629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.166096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.175650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:25.177881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:25.195214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:25.197053 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 380/749] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:25.203186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:25.218063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832e156-d0eb-4ca0-ad7e-f7e743ff3e38 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:25.235358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:25.236222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.236632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.237047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.237947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:25.238363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:25.240471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac34de-3c6b-40f9-8847-b1abb9e0d2bf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:25.263686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 370/750] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:25.269512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:25.284202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb19722-cc3b-4257-9e03-a764c9c97b88 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:25.292634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e5c2d-28ed-45bb-8e56-642866b6dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:25.293777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5c2d-28ed-45bb-8e56-642866b6dd86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.294202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5c2d-28ed-45bb-8e56-642866b6dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.294653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e5c2d-28ed-45bb-8e56-642866b6dd86 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/0d58bb9324d548b9b0e5fec7ae458a6a/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.300529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5c2d-28ed-45bb-8e56-642866b6dd86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=0d58bb9324d548b9b0e5fec7ae458a6a, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:25.303404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e5c2d-28ed-45bb-8e56-642866b6dd86 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:25.410152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 381/751] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:25 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/0d58bb9324d548b9b0e5fec7ae458a6a/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:25.826638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb1d8-7bf6-443e-b9ba-12f4056b5ba9 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.827186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb1d8-7bf6-443e-b9ba-12f4056b5ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.827186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eb1d8-7bf6-443e-b9ba-12f4056b5ba9 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.829246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 371/752] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:25.834941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.835343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.835507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:25.855417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:25.856711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:25.934815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 382/753] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:25 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:25.971749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eb1d8-7bf6-443e-b9ba-12f4056b5ba9 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:25.989870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eb1d8-7bf6-443e-b9ba-12f4056b5ba9 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:25.995932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:25.996724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:25.997009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:25.997285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.011798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:26.021392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:26.022938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 372/754] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:26.029761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.042669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6c908-fcbc-4b6c-81c3-d34a5c1feedc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.047763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.048529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.048810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.049085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.049836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:26.050138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.051793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.066178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 383/755] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:26.071712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.083808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed29d0-2ab8-4cf9-befe-776eb7a67825 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.089621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.090480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.090767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.091043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.107274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.109135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.128034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:26.129472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 373/756] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:26.134901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.147463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e109-16d6-49f7-b308-5a606f4f4566 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.154295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.154942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.155325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.155610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.156361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:26.156717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.158366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.172869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 384/757] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:26.178422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.188673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3e63-b01b-4316-8cc1-fac2493804f2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.193408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.194232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.194515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.194790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.204254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.206322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.221066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 00:50:26.222534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 374/758] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:26.228223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.239007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b86f40-d076-42cc-a93d-131bbc773f22 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.244618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.246407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.246931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.247512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.249164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:26.249663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.252988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.277922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 385/759] 10.222.0.91 () {56 vars in 1156 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:26.283468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.297666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3412-49e2-4ee9-ba17-115fee177560 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.303255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.304036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.304322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.304599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.323859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.323859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.333801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 375/760] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 00:50:26.339797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.366516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e61c50-96d4-4842-8a26-bd514a5b86b7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.376547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.377413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.377754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.378032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.395985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.397840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.428656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:26.430195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 386/761] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:26.436255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.450802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bab31b-785c-4187-9c8a-a37cdd70661c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.457847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.458811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.459096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.459415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.460178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:26.460493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.462160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.483417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 376/762] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:26.489078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.512427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4eac9-6f35-468b-bb6c-10373dff6183 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.524518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.525627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.526127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.526672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.536987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.539277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.560024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:26.561889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 387/763] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:26.567366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.585264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d20109-47b5-43cb-a660-05fb15fbdddb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.594547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.595194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.595481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.595754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.596631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:26.596973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.599025 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d624d0-af36-4e9d-a6ba-6a6ea05fd5b2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.621038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 377/764] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:26.627311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:26.640908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ff04-5ed8-44dd-9476-6b707bc4fd58 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:26.656510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:26.657485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:26.657989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:26.658460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:26.659514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=bde8ac2fb5804342b943a6999b23fedd) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:26.660056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:26.662079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9297205-b1b0-4dfa-b7f2-bb19eae4ae1d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:26.669206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 388/765] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:26 2022] GET /identity/v3/role_assignments?user.id=bde8ac2fb5804342b943a6999b23fedd&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:27.305270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2aed5-8d3a-41af-b53f-b749c03b1467 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.305795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2aed5-8d3a-41af-b53f-b749c03b1467 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.305873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2aed5-8d3a-41af-b53f-b749c03b1467 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.307960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 378/766] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:27.313518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.313969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.314148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.333258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:27.334691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:27.342519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a1a24-974f-4ae3-bd8c-6f2ddaee793b None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.342818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a1a24-974f-4ae3-bd8c-6f2ddaee793b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.343102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a1a24-974f-4ae3-bd8c-6f2ddaee793b None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.345034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 379/767] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:27.346751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 389/768] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:27.350047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.350341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.350623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.371241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.388096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38544029-f658-4bd3-b9e6-c8dbeddfc9d0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.389662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:27.390851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:27.397565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.398356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.398644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.398925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.412890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 380/769] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:27 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:27.421937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:27.428974 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:27.430501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 390/770] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:27.436835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.444706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.448413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187bc0-c9e7-48c2-814c-4a129f099774 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.456335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd196de-ba54-44f4-b2c4-6f79b8e08cae admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.460808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.461478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.461788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.462034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.462787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.463089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.465242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.472469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.473314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.473590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.473865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.474535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.475608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:27.475608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:27.475608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:27.476524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.479569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 381/771] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:27.486016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.492776 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 00:50:27.498747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 391/772] 10.222.0.91 () {56 vars in 1150 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:27.500048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.506142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7e5d9-1c2f-4c86-9af0-949ac857a51a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.510157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be354b61-7fdd-4712-b3c1-38ca4bb5eabc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.515133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.515342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.516166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.516448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.516551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.516772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.517236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.517718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.518610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.519158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.520372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:27.520372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:27.520372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:27.521794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.532438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 392/773] 10.222.0.91 () {56 vars in 1145 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:27.534930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.543065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.544905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.548077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe6858-6c0b-4d8d-9886-32d3889b47ce admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.553058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.554126 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.554607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.555075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.556114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.556998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.559634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.571657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 393/774] 10.222.0.91 () {56 vars in 1145 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:27.574047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.584616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668eedf-cd62-4e1d-8781-85f5424a98ff admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.587525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:27.589194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 382/775] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:27.590264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.591143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.591641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.592161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.593146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] RBAC: Adding query filter params (interface=public, service_id=bdaefd60bfa742e2b647aa8352def01a, region_id=RegionOne) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.593839 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.595049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:27.595049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:27.595049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:27.596349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.600789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.610053 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 394/776] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/endpoints?service_id=bdaefd60bfa742e2b647aa8352def01a&interface=public®ion_id=RegionOne => generated 194 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:27.611590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.622903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720761f-94b2-4035-a076-a1b5ec7ab736 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.623197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587acc22-1492-497d-86c6-d99c8d175c9d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.628410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.629366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.629856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.630350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.631280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.633277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.646566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.646566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.646566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.646566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.646983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.646983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.646983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.647702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 395/777] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/services => generated 772 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:27.679886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 383/778] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:27.686149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.702294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bccffe-f4d8-46da-83e6-fc1aeaf7ed05 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.713990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.715305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.715875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.716365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.730536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.733253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.749764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 00:50:27.751777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 396/779] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:27.757382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.768758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43717319-8ef3-4753-aa16-c80acb0c1024 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.774059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.801305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 384/780] 10.222.0.91 () {56 vars in 1170 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:27.809578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.822865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9360c-734b-4756-8a66-45faa442f529 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.830935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.832184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.832741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.833497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.852311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.855076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.874335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:27.876429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 397/781] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:27.885234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.898325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907af08-2a2c-4889-9d22-f01b738e93f9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.907430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.908625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.909111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.909587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.910729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:27.911311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.913298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.928054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 385/782] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:27.937027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:27.950237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da43856-a7d0-47dc-a896-ef9a49a161a6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:27.955683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:27.956902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:27.957431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:27.957908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:27.971582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:27.974034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:27.989926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:27.991805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 398/783] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:27.997769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.009565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1eecc-78aa-45a9-8964-9cbdf929f65c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.015066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.016084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.016569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.017091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.018124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.018637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.020856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807cc5f-e3ea-4010-9399-94786dfb5145 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.034977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 386/784] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.040336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.051507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956fddc-7ea1-442a-b6cc-cfc6e123958b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.056607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d505d-425f-4a9c-a14d-cc1d7227011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.058540 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d505d-425f-4a9c-a14d-cc1d7227011b admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.059065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d505d-425f-4a9c-a14d-cc1d7227011b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.059536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d505d-425f-4a9c-a14d-cc1d7227011b admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/70eaa9515db94bc99055f1f8db7890ea/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.078899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d505d-425f-4a9c-a14d-cc1d7227011b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=70eaa9515db94bc99055f1f8db7890ea, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.081938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d505d-425f-4a9c-a14d-cc1d7227011b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.101667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664408-ada0-4131-85f5-d8c91a891a9a None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.101954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664408-ada0-4131-85f5-d8c91a891a9a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.102238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664408-ada0-4131-85f5-d8c91a891a9a None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.104340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 387/785] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:28.109502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.109793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.110073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.130844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:28.134466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:28.147439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 388/786] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:28 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:28.162204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 399/787] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:28 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/70eaa9515db94bc99055f1f8db7890ea/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:50:28.202094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.212277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d39ac-f237-40ae-8277-2f68029132fe None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.285479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.286357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.286641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.286917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.287640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.289356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.294273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9db4d-01bf-4061-bca7-e38f42c092f6 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.294565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9db4d-01bf-4061-bca7-e38f42c092f6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.294845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9db4d-01bf-4061-bca7-e38f42c092f6 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.296940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 400/788] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:28.301584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 00:50:28.303049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 389/789] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/services/network => generated 88 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:28.305145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.305449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.305731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.309272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.326144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a866de5-8edf-449f-adde-03bb4cb6593d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.327007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:28.328319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:28.334245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.334843 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.335232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.335609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.336459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] RBAC: Adding query filter params (name=network) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.336775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.338003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 401/790] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:28 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:28.338426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.348963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 390/791] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.356248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.376388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.378169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145dc79-38fd-43fa-91e7-bedb5f219ee7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.383152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.383821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.384139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.384419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.385203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.385514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.388289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.393055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b314533-0a1b-46ab-a79c-1a796e4ef99e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.394204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 402/792] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.399551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.401120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.401968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.402317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.402711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.413668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc256b-1d2c-432c-823d-d3c1d0d40020 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.419257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.420042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.420526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.420813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.421781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] RBAC: Adding query filter params (interface=public, service_id=5b0ad5ce215d45ac9603d59cf4cad9aa, region_id=RegionOne) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.422099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.423867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.431012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 403/793] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/endpoints?service_id=5b0ad5ce215d45ac9603d59cf4cad9aa&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.436789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:28.437968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.443808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:28.449643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eb57b-3fa1-40a7-888e-1da05f009958 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.452086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 391/794] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:28.455044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.456014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.456485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.457023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.457911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.460075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.461855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.467301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 404/795] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:28.490582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929762fc-100c-4335-a84e-9d4175d91946 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.500973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.501657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.501943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.502219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.502983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.503290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.504959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.520571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 392/796] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:28.525844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.542294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa1ec1-8f63-4594-bfc3-8589313a131d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.550242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.551042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.551331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.551607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.567571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.569620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.592488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:28.594024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 405/797] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:28.599678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.617172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c94d2b-bff1-498f-a23c-b329feefce83 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.628162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.628840 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.629125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.629404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.630143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.630450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.632080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.658368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 393/798] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.663637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.679535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa77e3-d5f6-4002-b53f-7d0af65674c3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.688095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.688877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.689163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.689443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.702828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.705411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.720618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:28.722491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 406/799] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:28.727720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.739649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aa0d2-6aa7-4f96-962d-7024fb2ef143 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.746203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.746864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.747211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.747494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.748373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.748683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.750525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.771628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 394/800] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.777356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.788445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d37671-ce22-4ee6-adf2-59f2f60ebda1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.795060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.795761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.796076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.796409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.805566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.807538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.818060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 407/801] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 00:50:28.823704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.834102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783cf32-40f0-46b2-b714-ab3a5aee4d57 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.839368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.840589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.840931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.841243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.852300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.854066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.872485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:28.874067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 395/802] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:28.879961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.890380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d046852-94aa-4fbf-8f15-83a96100775d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.895110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.895824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.896159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.896438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.897208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.897514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.899099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.911882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 408/803] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:28.917403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.928792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865369c-7c5e-467e-84b6-294bec182a42 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.936439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.937276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.937559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.937879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.946507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.949161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:28.962819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:28.964469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 396/804] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:28.970208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:28.980595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce074-63d1-45c3-9f85-0ae9994c8206 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:28.985233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:28.985877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:28.986217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:28.986497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:28.987370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:28.987683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:28.989745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670d00-9ec1-462b-a918-e9d1ec7cfa48 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:29.003809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 409/805] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:29.009672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:29.022741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbb675-fa05-44ec-ad20-345d9ce5ecc2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:29.028422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:29.029118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:29.029404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:29.029680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:29.030567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=0d58bb9324d548b9b0e5fec7ae458a6a) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:29.030879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:29.032928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a34253-8bba-449a-8ce4-e8b721e3adff admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:29.039770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 397/806] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:29 2022] GET /identity/v3/role_assignments?user.id=0d58bb9324d548b9b0e5fec7ae458a6a&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:29.739534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233186a-69ed-4678-9938-dfcf99df3f90 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:29.740113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233186a-69ed-4678-9938-dfcf99df3f90 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:29.740113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233186a-69ed-4678-9938-dfcf99df3f90 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:29.742417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 410/807] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:29.749553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:29.750080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:29.750080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:29.777020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:29.778264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:29.786793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 398/808] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:29 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:29.812167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233186a-69ed-4678-9938-dfcf99df3f90 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:29.829529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233186a-69ed-4678-9938-dfcf99df3f90 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:29.834409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:29.835219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:29.835506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:29.835786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:29.859172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:29.866150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:29.867673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 411/809] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:29.874381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:29.889985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587f071-bbbd-49d5-b7ee-72357d02cf87 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:29.901443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:29.902121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:29.902409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:29.902692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:29.903448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:29.903926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:29.905529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:29.923465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 399/810] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:29.928849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:29.943352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619946ed-c2ea-445a-a635-48e3419eec8e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:29.952723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:29.953511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:29.953794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:29.954068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:29.975166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:29.977204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.002783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:30.004257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 412/811] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:30.009750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.024061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc33f4-5731-4194-a372-c27c187a6cd6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.033552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.034207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.034542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.034819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.035613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:30.035939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.037593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.061106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 400/812] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:30.066632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.080636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ceb1eb-ee51-45ba-b7f6-d4fa30fa6740 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.092467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.093262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.093547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.093823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.105435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.107470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.133765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 00:50:30.137331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 413/813] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:30.142937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.157297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643ff19-4d59-4306-9e81-57273c7febf7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.169082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.169868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.170155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.170428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.171332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:30.171642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.173602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.203651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 401/814] 10.222.0.91 () {56 vars in 1156 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:30.209282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.228692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03625930-531c-428b-b05d-6e3a18424b59 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.240481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.241294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.241534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.241806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.256247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.258012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.282172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:30.283381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 414/815] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:30.289095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.305093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff75c86-4281-4a5c-8587-e2bebcdf7f06 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.313910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.314620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.314904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.315179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.315982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:30.316286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.317920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.336761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 402/816] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:30.342926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.357517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe10b4b-31ef-4792-a821-459e3853a474 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.367583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.368407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.368694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.368967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.377420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.379398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.398503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:30.400107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 415/817] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:30.407895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.423320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0898bb-8a25-4677-8ac6-409fca4006c6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.435053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.435816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.436125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.436398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.437244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:30.437549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.439463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deefa0e-917f-4c25-a7b7-6156c2e5a971 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.461211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 403/818] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:30.467878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.477869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc988d9-3178-4db9-8620-71142b24d7fa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.488263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.488982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.489268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.489602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/bde8ac2fb5804342b943a6999b23fedd/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.491616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=bde8ac2fb5804342b943a6999b23fedd, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.494312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.577698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9104-db73-4e7e-bb62-0965ba874304 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.577997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9104-db73-4e7e-bb62-0965ba874304 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.578179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9104-db73-4e7e-bb62-0965ba874304 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.580193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 404/819] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:30.585905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.586190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.586470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.606499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:30.607728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:30.616213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 405/820] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:30 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:30.634238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 416/821] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:30 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/bde8ac2fb5804342b943a6999b23fedd/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:30.663069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.676450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabdc63-aca8-4bdf-a9a6-58fa0a8dda77 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.745961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.746912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.747199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.747476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.748171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.749852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.768474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 00:50:30.769980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 406/822] 10.222.0.91 () {56 vars in 1150 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:30.776903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.788357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623235a-b338-488d-ae97-02b0ebf8b803 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.798036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.798741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.799135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.799403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.800164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:30.800593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.802295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.808516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 417/823] 10.222.0.91 () {56 vars in 1145 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:30.815214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.826904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5238c5-78d9-4588-b052-3cab9791e15c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.834512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.835101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.835435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.835716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.836532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:30.836893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.838656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fce82-da94-4bf4-9a16-835792326ba2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.847142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 407/824] 10.222.0.91 () {56 vars in 1145 bytes} [Mon Feb 21 00:50:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:30.853579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:30.864209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b0dc9-b20f-467e-86f0-30dd0e9fbf71 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:30.869013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:30.869723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:30.870037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:30.870315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:30.871063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:30.872117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:30.872117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:50:30.872117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:50:30.873001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a89c46-2126-4967-890d-a82354e3f162 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:30.985691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 418/825] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:31.389295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559541-a1a6-427a-b3de-90dcebe32f74 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.389631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559541-a1a6-427a-b3de-90dcebe32f74 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.389841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1559541-a1a6-427a-b3de-90dcebe32f74 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.391904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 408/826] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:31.396997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.397355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.397637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.417262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:31.418447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:31.439822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 419/827] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:31 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:31.466222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559541-a1a6-427a-b3de-90dcebe32f74 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.481890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1559541-a1a6-427a-b3de-90dcebe32f74 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.486360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984c5f-c2f9-4bee-8f27-f3caa70f9b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.487151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984c5f-c2f9-4bee-8f27-f3caa70f9b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.487437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984c5f-c2f9-4bee-8f27-f3caa70f9b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.487715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984c5f-c2f9-4bee-8f27-f3caa70f9b65 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.507543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984c5f-c2f9-4bee-8f27-f3caa70f9b65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:31.519614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-20984c5f-c2f9-4bee-8f27-f3caa70f9b65 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:50:31.521101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 409/828] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:31.527255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.534303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daecd36-a7ad-485b-ae37-3aa676f19f1f None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.534593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daecd36-a7ad-485b-ae37-3aa676f19f1f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.534873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daecd36-a7ad-485b-ae37-3aa676f19f1f None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.537496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 410/829] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:31.541036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d770de-da82-4bbd-83a7-2c79ea4bc129 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.546113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.546890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.547072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.547374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.548932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.549214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.549492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.558953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:31.559273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.560962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.576666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 420/830] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:31.578070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:31.579273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:31.582323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.593783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27458b-88e0-497e-a062-2ade8d065920 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.598684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.599523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.599813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.600110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.602475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 411/831] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:31 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:31.613093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.614883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.632971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:31.633569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.634270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 421/832] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:31.641167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.653157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e4d2-f5a4-4f9e-b06f-79578dd9e1b1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.654558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048eee27-e95a-4488-9b45-89308f06f368 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.658195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.659116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.659495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.659780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.660597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:31.660904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.662569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.672576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.673381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.673663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.673941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.674608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.676252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.677758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 422/833] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:31.684288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.694823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1d694-0223-4799-b83f-f9321074534f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.696716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 00:50:31.701060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.702106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.702542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.702966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.704003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 412/834] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/services/network => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:31.710996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.722303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c195-8823-4765-a030-3e5d34377dd1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.723489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.725886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.738332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.739140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.739525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.739929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.740775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] RBAC: Adding query filter params (name=network) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:31.741204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.742903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.744833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 00:50:31.746640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 423/835] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:31.752203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.754881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 413/836] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:31.761604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.764249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b0b1-9bcf-4a56-8ae5-87c023b5f9e3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.769402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.770338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.770785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.771227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.772474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:31.773033 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.775162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.778569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffcb18-9354-4a0b-a2de-daf9ddff90cb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.793818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.796075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.797585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.798087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.799034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:31.800313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.803475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.815662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 424/838] 10.222.0.91 () {56 vars in 1170 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:31.819893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 414/838] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:31.821016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.828833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.840058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089bc5d6-72cc-4bfe-bf16-82b3a1960631 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.845865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583c59-5761-48c8-b277-6a575871c9a2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.850950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.851646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.851960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.852244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.853014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.855376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.862248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.862911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.863233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.863453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.878753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.880597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.891431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 415/839] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 00:50:31.897001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.906109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d244a96-c107-4ce7-8298-199a7e478b5d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.911005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.912064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.912597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.913148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.924676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.926743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:31.945679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:31.947438 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 416/840] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:31.953868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:31.963225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 425/841] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:31.969161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbfe4b-8c49-486e-83e1-993c57a5292e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:31.992326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:31.993349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:31.993883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:31.994308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:31.995779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:31.996279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:31.998146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.018443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 417/842] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:32.024387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:32.038344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71c8ac-ec80-4eff-80a4-428a04fa8e7b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:32.045952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:32.047070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.047529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.052191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.061270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:32.063630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.084017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:32.085945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 426/843] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:32.092869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:32.108493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5b3f3-cc96-43fc-8714-82c8016c29cf admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:32.113889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:32.114846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.115318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.115740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.116747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:32.117205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:32.119246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c4d2a-2b42-4c5b-ac1e-dcd0eb240c7a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.138540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 418/844] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:32.145194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:32.156877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751931a-46fb-4436-bce6-12ae3a51a890 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:32.162011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:32.162966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.163396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.163817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.164845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=70eaa9515db94bc99055f1f8db7890ea) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:32.165343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:32.168014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f55243-19d9-46dc-a118-da178731e2ab admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.175119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 427/845] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:32 2022] GET /identity/v3/role_assignments?user.id=70eaa9515db94bc99055f1f8db7890ea&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:32.207371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7cbf0-4215-4a6b-a937-3bb1383503b8 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.207662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7cbf0-4215-4a6b-a937-3bb1383503b8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.207978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7cbf0-4215-4a6b-a937-3bb1383503b8 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.210541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 419/846] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:32.217036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.217322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.217600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.242318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:32.243756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:32.252916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 428/847] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:32 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:32.276147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7cbf0-4215-4a6b-a937-3bb1383503b8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:32.290175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7cbf0-4215-4a6b-a937-3bb1383503b8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:32.297772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:32.298712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.298998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.299271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.300047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:32.301860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.315111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 00:50:32.316741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 420/848] 10.222.0.91 () {56 vars in 1153 bytes} [Mon Feb 21 00:50:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:32.322779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:32.333017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166abd9-69d9-4e50-ae0a-1d4f96cb4c5d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:32.338152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:32.339088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.339389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.339764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.340548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:32.340908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:32.342683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597cb30-5340-453a-bfd3-efa3a448a9bf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.348658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 429/849] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:32.360233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:32.371416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9819b-febf-485e-a6ce-dda5c01742ac admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:32.376917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:32.377589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:32.377922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:32.378198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:32.378916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:32.379268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:32.381122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e7cbf-c0bc-45b7-9268-f8b62be7568f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:32.387531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 421/850] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:33.350339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872c8d-4736-4a5f-81fc-72b0eaed3179 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.350884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872c8d-4736-4a5f-81fc-72b0eaed3179 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.350884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872c8d-4736-4a5f-81fc-72b0eaed3179 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.353101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 430/851] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:33.358927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.359355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.359520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.378442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:33.379628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:33.389535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 422/852] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:33 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:33.413553 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872c8d-4736-4a5f-81fc-72b0eaed3179 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.426801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872c8d-4736-4a5f-81fc-72b0eaed3179 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.431299 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.432634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.432943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.433455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.444461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:33.452342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:33.453850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 431/853] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:33.460081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.469843 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093d917-fcb5-453b-9abc-2ada62948160 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.474450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.475112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.475398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.475674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.476458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:33.476766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.478391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.488488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 423/854] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:33.494086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.505661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba8379-89c0-474e-b647-02c142d6ee08 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.511520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.512449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.512738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.513018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.524483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.527604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.545801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:33.547351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 432/855] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:33.553047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.565154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b592c-92da-4bb3-9a70-1f522e17ee38 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.573702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.573702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.574222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.574551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.575160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:33.575476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.577181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.595995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 424/856] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:33.597848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.609071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a89b4-66df-43bf-ad9e-bb87eec3c242 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.613805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.614656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.614938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.615267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.623739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.625822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.641082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 00:50:33.642618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 433/857] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:33.648804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.661248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7dab-8ca1-423c-afd2-dc699210121b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.666121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.667691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.668202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.668763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.669809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:33.670359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.672614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.691057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 425/858] 10.222.0.91 () {56 vars in 1156 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:33.696175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.707320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884ed58-cb9e-423b-9559-847b02600adc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.712323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.713019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.713305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.714215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.723039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.724898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.734626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 434/859] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:33.740244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.750344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e55bc-e8a5-49a9-92a5-ea6adc3911ae admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.755088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.755885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.756176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.756465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.767812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.769734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.788673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:33.790138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 426/860] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:33.795899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.804885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfc908-9534-4498-9ce3-293ebe532b58 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.810055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.810701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.811040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.811323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.812078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:33.812391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.813982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.827251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 435/861] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:33.832787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.844512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45aa777-cacd-466e-be7f-15a09f6a7ab4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.849167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.850009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.850297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.850574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.858399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.860561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.874575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:33.879342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 427/862] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:33.881895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.893006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74954f8-4359-4c04-9364-a246921e67c1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.897753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.898518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.898810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.899091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.899970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:33.900291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.902830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97025ae-017d-42c4-b72b-1f098ae6c9e5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.916215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 436/863] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:33.923022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:33.935023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ac3ae-5870-4f57-a366-d2a0ec164126 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:33.939897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:33.940587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.940871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.941207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.942036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=bde8ac2fb5804342b943a6999b23fedd) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:33.942402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:33.944481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8be0-ecff-4530-bd01-dab2c6df559e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:33.951543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 428/864] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:33 2022] GET /identity/v3/role_assignments?user.id=bde8ac2fb5804342b943a6999b23fedd&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:33.963322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f32db-7804-4513-87e9-18d910eab4d8 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.963826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f32db-7804-4513-87e9-18d910eab4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.964238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f32db-7804-4513-87e9-18d910eab4d8 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.966513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 437/865] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:33.972335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:33.972645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:33.972882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:33.992160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:33.993390 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:34.002322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 429/866] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:33 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:34.025385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f32db-7804-4513-87e9-18d910eab4d8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.039083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f32db-7804-4513-87e9-18d910eab4d8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.043822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.044658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.044935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.045207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.045873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:34.047483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:34.059258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 00:50:34.060881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 438/867] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:34.066716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.076676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c9647-4882-4acf-8cf3-497504f4c4d3 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.081350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.082030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.082309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.082582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.083550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:34.083935 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:34.085503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cc7d3-91b5-4901-bfe8-4c6eb7239401 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:34.091660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 430/868] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:34.097428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.107636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fa03-e278-4c92-8caf-10e88cfd459b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.112520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.113120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.113403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.113681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.114405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:34.114711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:34.116336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5f02-f7f8-4ca2-a13a-adcdf9872be5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:34.125541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 439/869] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:34.801335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e111-b768-4e17-a250-09e279a7d355 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.801335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e111-b768-4e17-a250-09e279a7d355 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.801335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e111-b768-4e17-a250-09e279a7d355 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.802611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 431/870] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:34.809102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.809102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.809102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.825231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150f4e1-6985-4d06-8740-497377879481 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.825850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150f4e1-6985-4d06-8740-497377879481 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.826591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150f4e1-6985-4d06-8740-497377879481 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.828876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 432/871] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:34.832846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:34.832846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:34.835003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.835501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.836107 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.841810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 440/872] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:34 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:34.855915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:34.857392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:34.865386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 433/873] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:34 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:34.867917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.876248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca35b0-429f-4b65-bfaf-a9f5b9bba588 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.880939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.881736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.882021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.882301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.891859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.895326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:34.900838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872dd33-e3f8-4527-b604-f1fd8e6e26b5 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.903431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 00:50:34.905127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 441/874] 10.222.0.91 () {56 vars in 1141 bytes} [Mon Feb 21 00:50:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:34.905631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.906287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.906570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.906844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.907567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:34.909210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:34.911900 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.924458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5da5ff-f42a-474e-af4f-bfb6a04ef058 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.929045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.929745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.930031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.930309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.931054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:34.931358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:34.933572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:34.947358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 442/875] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:50:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:34.949679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:34.959775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e346f-8dde-43b8-be82-6512498d657b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:34.964575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:34.965358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:34.965643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:34.965920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:34.985531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:34.988225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:34.992010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 434/876] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:34 2022] POST /identity/v3/services => generated 269 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:35.009943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:35.016550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 443/877] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:35.019095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.039644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71f87-c2c3-4a21-9746-d6b57e9f5107 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.045191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.045856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.046137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.046414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.047140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:35.047444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.049220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.062429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 435/878] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:35.068213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.079303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ceaf-1d45-44cf-9bc9-1e86e09a3ff0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.085004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.086220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.086730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.087220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.096918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.099371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.117246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 00:50:35.123525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 444/879] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:35.126031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.136859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5e968-c74e-4840-b650-333967f6942c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.142004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.143048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.143572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.144092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.145163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:35.145688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.147890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.173836 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 436/880] 10.222.0.91 () {56 vars in 1170 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:35.175570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.186577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44653d9-9a6e-4d79-aab6-6f50b2071667 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.191710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.192701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.193168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.193601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.204280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.206343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.218197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 445/881] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:35.222735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.233508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa842929-4769-44c6-9110-2fe308332249 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.238146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.238930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.239213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.239492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.251503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.253374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.270998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:35.275956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 437/882] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:35.278539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.287999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95789f22-5abd-43ff-aff7-31129b1f413a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.293709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.294383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.294718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.294996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.295873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:35.296191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.298104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.316042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 446/883] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:35.317782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.328360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df933-0ab8-4b42-a760-83403b8b92b1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.333464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.334236 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.334562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.334838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.345133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.347226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.366819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:35.368405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 438/884] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:35.374520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.384614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47451d-fa3b-44d5-bdb3-0fd409fa12a8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.393257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.394322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.394792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.395255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.396926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:35.397460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.401462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf2e37-2020-41a4-924c-2c25201924aa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.419963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 447/885] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:35.421315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:35.442319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4b26-7cf2-49c0-8bb6-26fab2db556b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:35.451567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:35.453045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:35.453828 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:35.454521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:35.456607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] RBAC: Adding query filter params (role.id=3c800633afdd49828ba4c2e676c38cc0, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=70eaa9515db94bc99055f1f8db7890ea) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:35.457410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:35.461897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56908235-70d1-4257-be5a-efc784bea151 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:35.477181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 439/886] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:35 2022] GET /identity/v3/role_assignments?user.id=70eaa9515db94bc99055f1f8db7890ea&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=3c800633afdd49828ba4c2e676c38cc0 => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:36.536462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5db7f-b4a0-4cc9-8220-be7131c8d455 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.536982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5db7f-b4a0-4cc9-8220-be7131c8d455 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.536982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5db7f-b4a0-4cc9-8220-be7131c8d455 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.539056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 448/887] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:36.544688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.545119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.545296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.561244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b452d3-f032-42cd-a427-7edef95665c0 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.561571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b452d3-f032-42cd-a427-7edef95665c0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.561815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b452d3-f032-42cd-a427-7edef95665c0 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.563866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 449/888] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:36.564332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:36.565579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:36.568835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.569127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.569414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.574517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 440/889] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:36 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:36.592040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:36.593239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:36.598874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:36.601874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 450/890] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:36 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:36.609288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17ea5d-0925-4201-8ac8-adf7939468f4 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:36.613991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee93c-cfb9-4b76-ad9c-32df48e4f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:36.614873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee93c-cfb9-4b76-ad9c-32df48e4f953 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.615350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee93c-cfb9-4b76-ad9c-32df48e4f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.615850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee93c-cfb9-4b76-ad9c-32df48e4f953 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.616761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ee93c-cfb9-4b76-ad9c-32df48e4f953 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:36.618537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ee93c-cfb9-4b76-ad9c-32df48e4f953 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:36.625827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:36.634967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c566c6-e42d-4f3b-90be-9a3b6fe4c884 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:36.639903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:36.640859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.640999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.643732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.643732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:36.643732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:36.658510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 00:50:36.660778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 451/891] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:36.666255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:36.677204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf309b-d8e9-402d-a292-b755404813e1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:36.683199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:36.683916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.684205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.689539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.689539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:36.689539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:36.689539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:36.692185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 452/892] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:36.697408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:36.707755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed5cc6-4b75-4739-b18b-e84330a8e430 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:36.712619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:36.713365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:36.714260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:36.714772 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:36.715529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:36.716025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:36.717806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35121b-7ebc-450e-ac59-acf2e2f482fd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:36.727881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 453/893] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:36.730575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 441/894] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:36 2022] POST /identity/v3/services => generated 251 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:37.429168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e376cc-7a72-46d5-8dd3-5c33cdd78f9a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.429492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e376cc-7a72-46d5-8dd3-5c33cdd78f9a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.429736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e376cc-7a72-46d5-8dd3-5c33cdd78f9a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.431803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 454/895] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:37.437192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.437485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.437766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.456075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:37.457267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:37.475170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 442/896] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:37 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:37.499237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e376cc-7a72-46d5-8dd3-5c33cdd78f9a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:37.511868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e376cc-7a72-46d5-8dd3-5c33cdd78f9a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:37.516316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:37.517106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.517387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.517662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.518324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:37.519930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:37.531513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 00:50:37.533009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 455/897] 10.222.0.91 () {56 vars in 1153 bytes} [Mon Feb 21 00:50:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:37.538776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:37.548482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45de2-ada9-4dc7-b431-07fc9d1c8c60 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:37.553100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:37.553754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.554039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.554318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.555029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:37.555330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:37.557558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:37.563053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 443/898] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:37.568825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:37.579283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8a9f5-e411-4b20-9d21-746e0f74aea4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:37.584478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607332e5-4474-4566-8238-2c347081efad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:37.585156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607332e5-4474-4566-8238-2c347081efad admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.585441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607332e5-4474-4566-8238-2c347081efad admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.585719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607332e5-4474-4566-8238-2c347081efad admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.586458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607332e5-4474-4566-8238-2c347081efad admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:37.586767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607332e5-4474-4566-8238-2c347081efad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:37.588508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607332e5-4474-4566-8238-2c347081efad admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:37.595059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 456/899] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:37.600920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:37.611682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896895-17c0-4ad6-9431-5af660d664a7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:37.616168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:37.616825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.617104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.617385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.618166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] RBAC: Adding query filter params (interface=public, service_id=0f250bc1b74a4ac98464381cddbfc393, region_id=RegionOne) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:37.618472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:37.621943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:37.621943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:37.621943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:37.622886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3a234-1b8a-4e34-8f2a-686ff32bacb5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:37.631550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 444/900] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:37 2022] GET /identity/v3/endpoints?service_id=0f250bc1b74a4ac98464381cddbfc393&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:37.637234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607332e5-4474-4566-8238-2c347081efad admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:37.648184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607332e5-4474-4566-8238-2c347081efad admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:37.653477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6a5d0-c8bf-4962-8038-d41d4bf4378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:37.654429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a5d0-c8bf-4962-8038-d41d4bf4378b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.654931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a5d0-c8bf-4962-8038-d41d4bf4378b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.655450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6a5d0-c8bf-4962-8038-d41d4bf4378b admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.656378 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6a5d0-c8bf-4962-8038-d41d4bf4378b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:37.658227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6a5d0-c8bf-4962-8038-d41d4bf4378b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:37.664916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 457/901] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:37 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 00:50:37.962363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d9313-7f5e-49d1-ab25-568e584f776a None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.962712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d9313-7f5e-49d1-ab25-568e584f776a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.962835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d9313-7f5e-49d1-ab25-568e584f776a None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.965484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 445/902] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:37.971215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:37.971504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:37.971785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:37.989888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:37.991070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:37.999600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 458/903] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:37 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:38.023621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d9313-7f5e-49d1-ab25-568e584f776a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.036080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d9313-7f5e-49d1-ab25-568e584f776a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.040519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.041365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.041654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.041932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.052833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:38.060720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 00:50:38.066802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 446/904] 10.222.0.91 () {56 vars in 1141 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:38.068175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.078023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf0a5-76ff-4891-8bb5-e1c7ab4e7a8f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.082630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.083610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.083960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.084245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.085119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:38.085433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.087106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.099964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 459/905] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:38.102160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.112478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb144bc-caa1-47f9-83a8-71af57593012 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.117282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.118103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.118383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.118711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.129605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.131480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.148993 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:38.154965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 447/906] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:38.156347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.166227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c721-643d-4adb-aeaa-6496e9661279 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.171084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.171731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.172099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.172380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.173109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:38.173414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.175061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.193166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 460/907] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:38.194504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.205414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507121ff-56d3-4155-9e42-8b4c08d89e1e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.210399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.211298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.211587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.211887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.219545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.221700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.236720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 00:50:38.242525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 448/908] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:38.243862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.254802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184b0a2-59ad-4e0c-86ed-34eb306d2bac admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.259484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.260419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.260855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.261202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.262083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:38.262448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.264382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.286879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 461/909] 10.222.0.91 () {56 vars in 1170 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:38.288502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.299027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cc99b-0eff-4143-ada3-c4a712140d51 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.303951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.304780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.305130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.305411 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.316817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.318715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.336930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:38.343241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 449/910] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:38.344622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.358166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe59233-c86d-441e-810f-cdcc5cb66834 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.363155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.363865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.364218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.364502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.365301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:38.365613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.367295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.383942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 462/911] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:38.386730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.397367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e167ad-440c-4589-8ac7-601f2e083396 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.403333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.404223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.407361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.407642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.415396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.417598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.431285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:38.437293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 450/912] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:38.438641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.450661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01231935-0182-4342-8efd-6b50665e5202 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.455782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.456738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.457253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.458010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.459096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:38.459596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.461782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0587d1-7536-4066-8de8-0ef7dfc66c29 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.480040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 463/913] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:38.482938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:38.496274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37defd11-5440-4e3a-a069-44c508a054c0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:38.501423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a4a1e-ae92-4269-b917-95ff3672f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:38.502561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4a1e-ae92-4269-b917-95ff3672f02b admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:38.503060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4a1e-ae92-4269-b917-95ff3672f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:38.503518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a4a1e-ae92-4269-b917-95ff3672f02b admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/70eaa9515db94bc99055f1f8db7890ea/roles/3c800633afdd49828ba4c2e676c38cc0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:38.506093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a4a1e-ae92-4269-b917-95ff3672f02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=70eaa9515db94bc99055f1f8db7890ea, role_id=3c800633afdd49828ba4c2e676c38cc0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:38.509095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a4a1e-ae92-4269-b917-95ff3672f02b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:38.627061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 451/914] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:38 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/70eaa9515db94bc99055f1f8db7890ea/roles/3c800633afdd49828ba4c2e676c38cc0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:50:39.173142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901aa8-c015-4670-8a82-cdb36f2d9845 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.173688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901aa8-c015-4670-8a82-cdb36f2d9845 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.173688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83901aa8-c015-4670-8a82-cdb36f2d9845 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.175689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 464/915] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:39.181230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.181524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.181877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.200582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:39.202353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d29b1-c440-4d88-9694-152533a6a57d None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.202644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d29b1-c440-4d88-9694-152533a6a57d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.202925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d29b1-c440-4d88-9694-152533a6a57d None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.204047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:39.204979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 465/916] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:39.212936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.213932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.214563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.232224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:39.233550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:39.268821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 452/917] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:39 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:39.293765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:39.301163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 466/918] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:39 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:39.308418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee0913-5ef0-4bc3-af19-c94dc0965dc7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:39.314252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:39.316099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.316562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.317008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.317931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:39.320611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:39.327980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:39.337250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9b77-2514-4d58-acd0-b4afcadd6458 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:39.342542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:39.343321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.348451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.348451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.348451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:39.348451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:39.357630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 00:50:39.363584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 467/919] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:39.364903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:39.376011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256041-a6e2-4a3c-8636-de7497f00219 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:39.380463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:39.381097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.381464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.381644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.382345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:39.382649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:39.384258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:39.389792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 468/920] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:39.395659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:39.407529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f45b35-5d73-476a-88de-035c78b19ad3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:39.412778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:39.413687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.414177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.414658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.415609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:39.416209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:39.418168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:39.424106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 469/921] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:39.429376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:39.438098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 453/922] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:39 2022] POST /identity/v3/services => generated 241 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:39.443550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f6443-b539-4836-8565-e7f6a19af717 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:39.460747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:39.461551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.461963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.462309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.463472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] RBAC: Adding query filter params (interface=public, service_id=e2e4b59f5a8949ab8072b521b35e2180, region_id=RegionOne) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:39.464171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:39.465992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d936a-d117-49ae-b2d2-0796ccc5747f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:39.472658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 470/923] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:39 2022] GET /identity/v3/endpoints?service_id=e2e4b59f5a8949ab8072b521b35e2180&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:39.478406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:39.490229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f42327-26be-4f8f-bee2-6ee4971bd0e9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:39.496201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f759-f77c-4e12-bb9d-d552abce8dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:39.497110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f759-f77c-4e12-bb9d-d552abce8dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:39.497464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f759-f77c-4e12-bb9d-d552abce8dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:39.497812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f759-f77c-4e12-bb9d-d552abce8dfe admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:39.498613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f759-f77c-4e12-bb9d-d552abce8dfe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:39.500386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f759-f77c-4e12-bb9d-d552abce8dfe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:39.507753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 454/924] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:39 2022] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 00:50:40.070370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79aa3-2e27-4a02-b15e-ea1cac335742 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:40.070940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79aa3-2e27-4a02-b15e-ea1cac335742 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:40.071453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d79aa3-2e27-4a02-b15e-ea1cac335742 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:40.074704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 471/925] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:40.079500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:40.079969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:40.080152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:40.099019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:40.100233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:40.108572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 455/926] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:40 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:40.130844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79aa3-2e27-4a02-b15e-ea1cac335742 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:40.147669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d79aa3-2e27-4a02-b15e-ea1cac335742 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:40.152736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:40.153527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:40.153808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:40.154081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:40.154819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:40.156465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:40.168973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 00:50:40.170519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 472/927] 10.222.0.91 () {56 vars in 1153 bytes} [Mon Feb 21 00:50:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:40.176515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:40.185989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e16cb-497c-430c-be26-03f165f0c6ba None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:40.190663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:40.191306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:40.191585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:40.191980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:40.192686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:40.193049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:40.194675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:40.200007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 456/928] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:40.205647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:40.217263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22725fc1-0df8-403c-aa1d-41a7f4fee307 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:40.222022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:40.222766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:40.223047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:40.223324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:40.224178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:40.224479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:40.226129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977050fc-a2b4-4b4e-8da1-776eb9ed52a2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:40.232322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 473/929] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:40.237880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:40.248748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1959ba-2b51-4639-a0e3-eaef962f651e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:40.253510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:40.254203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:40.254483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:40.254808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:40.255616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:40.256712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:50:40.256712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:50:40.256712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:50:40.257639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013abbf-97d8-4579-8d19-f19ddd469b33 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:40.334176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 457/930] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:41.067649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f1225-c46b-40da-9e75-3964b3e623aa None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.068079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f1225-c46b-40da-9e75-3964b3e623aa None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.068292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f1225-c46b-40da-9e75-3964b3e623aa None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.070318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 474/931] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:41.076163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.076453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.076732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.095377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:41.096607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:41.114565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 458/932] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:41 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:41.138931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f1225-c46b-40da-9e75-3964b3e623aa None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.152265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f1225-c46b-40da-9e75-3964b3e623aa None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.156818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.157603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.157879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.158151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.170505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:41.177737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 00:50:41.179230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 475/933] 10.222.0.91 () {56 vars in 1141 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:41.185133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.194214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da7197-aac4-41ee-858e-993fcf8225e2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.199372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.200156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.200437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.200712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.201506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:41.201816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.203416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.212489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 459/934] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:41.218619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.229777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e1349-8cc4-4dcc-953c-35e9ee2b9edb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.234403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.235163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.235442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.235767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.247086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.248966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.266357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:41.267860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 476/935] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:41.277327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.289560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d705fa9-8e81-4f40-991b-fda457153c92 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.295232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.296203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.296710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.297187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.298170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:41.298668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.300548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.313907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 460/936] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:41.319933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.331788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ada8f7-b340-4739-9f1a-1c0149d1cce3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.337130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.338909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.339383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.339941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.348221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.350516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.373757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 00:50:41.375624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 477/937] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:41.381560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.392374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a249b-95a2-42e5-b2c1-da8de9859c34 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.397532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.398501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.398971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.399477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.400772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:41.401272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.403572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.425381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 461/938] 10.222.0.91 () {56 vars in 1170 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:41.430851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.443735 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e236fec-ff80-49a4-afff-3a4d4eeb6a01 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.449010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.449952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.450441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.450974 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.460333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.462408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.473112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 478/939] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:41.479726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.490191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eaa2b-e9ea-440c-a376-e72af0c63297 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.496067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.497185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.497724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.498202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.509600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.512616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.531789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:41.533842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 462/940] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:41.539994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.550431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe36b98-c995-4a5e-94e3-10c8b35bdff0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.556012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.557141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.557742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.558251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.559324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:41.559961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.561932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.576702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 479/941] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:41.582457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.594187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fecd8-92b6-491a-ab81-cd8748a0a33c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.599381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.600557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.601111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.601634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.610311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.612777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.628365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:41.630319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 463/942] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:41.637180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.647938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d302-52a8-4575-85eb-e7e37a6e2453 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.653504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.654480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.654992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.655495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.656598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:41.657168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.659323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600e436-98a6-4b95-b5ba-68631a08b347 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.673797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 480/943] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:41.680006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.692144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2ae18-4694-41df-b8fb-abe4c354f0ae admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:41.697205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:41.698856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.699396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.699907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.701027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] RBAC: Adding query filter params (role.id=3c800633afdd49828ba4c2e676c38cc0, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=70eaa9515db94bc99055f1f8db7890ea) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:41.701557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:41.703679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607f6b-730a-4590-84a8-ec6db0fcc0d0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:41.710514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 464/944] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/role_assignments?user.id=70eaa9515db94bc99055f1f8db7890ea&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=3c800633afdd49828ba4c2e676c38cc0 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:41.920050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728415b3-f8bc-4c4c-b4c9-9370bfad0d7b None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.920724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728415b3-f8bc-4c4c-b4c9-9370bfad0d7b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.921281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728415b3-f8bc-4c4c-b4c9-9370bfad0d7b None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.923298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 481/945] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:41.929096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3659d-a384-42c6-9b2c-2e0bef5ec4f5 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.929639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3659d-a384-42c6-9b2c-2e0bef5ec4f5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.930138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3659d-a384-42c6-9b2c-2e0bef5ec4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.949941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bca3659d-a384-42c6-9b2c-2e0bef5ec4f5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:41.951148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bca3659d-a384-42c6-9b2c-2e0bef5ec4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:41.959725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 465/946] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:41 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:41.985005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728415b3-f8bc-4c4c-b4c9-9370bfad0d7b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:41.992275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eb1d4-3e3b-440e-9691-95058ff83d86 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:41.992563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eb1d4-3e3b-440e-9691-95058ff83d86 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:41.992853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eb1d4-3e3b-440e-9691-95058ff83d86 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:41.995676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 466/947] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 00:50:42.000874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728415b3-f8bc-4c4c-b4c9-9370bfad0d7b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.001162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.001402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.001686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.007072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.008150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.008443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.010298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.011576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.014048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.021254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:42.022455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:42.028291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 00:50:42.031547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 467/949] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:41 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:42.032486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 482/949] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:42.037060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.046791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83299-0ee4-409d-94b5-78e4ba496099 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.051456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.052160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.052444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.052722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.053432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:42.053743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.055501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.056175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.065437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 468/950] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:42.066684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.067365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b59512-465d-4c01-8cc6-31eeaf7bdaaa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.073419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.074335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.074625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.074904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.075618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.077155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab38fee-4e06-484c-b327-c10d92925b77 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.077341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.082004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.082950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.083238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.083517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.084251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:42.084556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.086125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.090738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 00:50:42.092278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 483/952] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:42.096834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 469/952] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:42.098020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.098227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.108471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a28f4-7a20-43fc-aa35-b7c44c45058e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.109112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a6dd7-96fd-4f2d-9d1c-de079d82f22c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.113138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.113786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.114073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.114313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.114494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.114997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.115182 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] RBAC: Adding query filter params (interface=public, service_id=cb6404ff8ff946ada1f096123f7248f8, region_id=RegionOne) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:42.115344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.115491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.115648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.116353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:42.116664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.117035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.118379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.126486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 484/954] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:42.127489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 470/954] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/endpoints?service_id=cb6404ff8ff946ada1f096123f7248f8&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:42.129503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.133013 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.141840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262276e9-ff0f-47a3-a0ec-823189956866 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.144215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b56e5-9e05-4024-b9d7-530386f0b717 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.146709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878fa0e-4da3-48c2-9eb3-042ff608112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.147424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fa0e-4da3-48c2-9eb3-042ff608112d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.147710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fa0e-4da3-48c2-9eb3-042ff608112d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.148022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878fa0e-4da3-48c2-9eb3-042ff608112d admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.148767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878fa0e-4da3-48c2-9eb3-042ff608112d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.149482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.150311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.151115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878fa0e-4da3-48c2-9eb3-042ff608112d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.151692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.152210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.152928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:42.153243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.154832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.164205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 471/956] 10.222.0.91 () {56 vars in 1135 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:42.164793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 485/956] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 00:50:42.165700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.176954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00bc40-c1df-4a13-ab6f-dca609247a96 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.182053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d13a4-338c-449a-bebf-503e526bd052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.183123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d13a4-338c-449a-bebf-503e526bd052 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.183414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d13a4-338c-449a-bebf-503e526bd052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.183754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d13a4-338c-449a-bebf-503e526bd052 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.184566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d13a4-338c-449a-bebf-503e526bd052 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.186284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d13a4-338c-449a-bebf-503e526bd052 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.286274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 472/957] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:42.847307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02573d-bd27-4069-b0e4-cec959264858 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.847828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02573d-bd27-4069-b0e4-cec959264858 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.847828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02573d-bd27-4069-b0e4-cec959264858 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.850009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 486/958] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:42.855590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.855913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.856200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.874669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:42.875854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:42.898067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 473/959] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:42 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:42.925183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02573d-bd27-4069-b0e4-cec959264858 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.938255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02573d-bd27-4069-b0e4-cec959264858 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.942808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.943659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.943976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.944252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.944919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.946570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.959018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 00:50:42.960668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 487/960] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:42.966530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:42.975632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5135bb6-28aa-4340-b65a-e1f868331305 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:42.981096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:42.981749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:42.982035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:42.982316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:42.983023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:42.983337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:42.984951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18acd9-7ad2-4362-b3b0-474caa61e68e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:42.990238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 474/961] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:42.996883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:43.007031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd51a-8e2d-48ad-818b-0e1aed63e05a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:43.012305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:43.013077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:43.013359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:43.013631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:43.014351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:43.014657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:43.016354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8585b-e243-457e-a73c-e6dce5a98784 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:43.021854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 488/962] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:44.172369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec5020-7ac1-4deb-a35e-75a8571f00bc None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.173093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec5020-7ac1-4deb-a35e-75a8571f00bc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.173093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec5020-7ac1-4deb-a35e-75a8571f00bc None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.175065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 475/963] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:44.181162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.182720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.182720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.202700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:44.203930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:44.212383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 489/964] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:44 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:44.235609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec5020-7ac1-4deb-a35e-75a8571f00bc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.248976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec5020-7ac1-4deb-a35e-75a8571f00bc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.253389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.254162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.254448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.254725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.255353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.256960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.268409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 00:50:44.270015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 476/965] 10.222.0.91 () {56 vars in 1126 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:44.276247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.285650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9e39f-3379-470a-8bfc-4ec56abcb958 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.290532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.291958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.291958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.292715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.293203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] RBAC: Adding query filter params (name=image) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:44.293512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.295141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df103c09-284b-416d-8ff4-7e9ca456f54a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.300809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 490/966] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:44.306492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.316938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665483ac-aa92-41cc-b9a9-a9aeaebdd16f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.321536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.322249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.323049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.323049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.324500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:44.324500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.326442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe021f2d-b76c-438b-96b0-56ddfd071001 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.332709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 477/967] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:44.665623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a603766-eca7-4579-8955-4273ffcc8277 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.666026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a603766-eca7-4579-8955-4273ffcc8277 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.666924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a603766-eca7-4579-8955-4273ffcc8277 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.669142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 491/968] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:44.674669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf7222-4bd0-431a-8b05-069e6b116b36 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.675039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf7222-4bd0-431a-8b05-069e6b116b36 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.675398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf7222-4bd0-431a-8b05-069e6b116b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.694418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bedf7222-4bd0-431a-8b05-069e6b116b36 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:44.695620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bedf7222-4bd0-431a-8b05-069e6b116b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:44.711953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 478/969] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:44 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:44.720227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cfec-bc62-4b08-96e3-9a70f757c5b0 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.720517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cfec-bc62-4b08-96e3-9a70f757c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.720796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14cfec-bc62-4b08-96e3-9a70f757c5b0 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.722786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 492/970] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:44.727856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.728183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.729719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.732692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cfec-bc62-4b08-96e3-9a70f757c5b0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.747093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14cfec-bc62-4b08-96e3-9a70f757c5b0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.749000 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:44.750443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:44.751722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.752534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.752927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.753202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.754038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.755864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.759447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 479/971] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:44 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:44.768045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 00:50:44.769557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 493/972] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:44.775952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.785368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43803e6-ff88-45dc-90b7-76c842ed47d8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.787157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.795496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.796454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.796995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.797536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.798192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a103d5-0fed-4388-9daf-2df3641e7f6f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.798691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:44.799277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.801546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.803376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.804429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.804788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.805136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.806231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.808837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.809027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 480/973] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:44.810183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.common [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 00:50:44.816846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.827168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f2907-6413-4de7-b149-751c06849911 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.831635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.832633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.832924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.833231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.833956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:44.834262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.835859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.841692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 481/974] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:44.846918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.856544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f627a-d00b-47ad-8355-29b3c019a0d5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.861044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ac9c9-2995-4058-9725-f2988fb9f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.861660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ac9c9-2995-4058-9725-f2988fb9f65f admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.861937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ac9c9-2995-4058-9725-f2988fb9f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.862209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ac9c9-2995-4058-9725-f2988fb9f65f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.862926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ac9c9-2995-4058-9725-f2988fb9f65f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.864573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ac9c9-2995-4058-9725-f2988fb9f65f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.874556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.sql.core [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 21 00:50:44.874556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 21 00:50:44.874556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [parameters: {'id': '1369e46f685540bf918beb197d15d205', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 21 00:50:44.874556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79590) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 00:50:44.881750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1369e46f685540bf918beb197d15d205.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1369e46f685540bf918beb197d15d205. Feb 21 00:50:44.883303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 494/975] 10.222.0.91 () {60 vars in 1161 bytes} [Mon Feb 21 00:50:44 2022] POST /identity/v3/projects => generated 262 bytes in 96 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:44.890088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.900278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e53b-9b33-4d9e-a369-15a99f36f413 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.904837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.905600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.905884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.906158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.912986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.915134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:44.928930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:44.930264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 495/976] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:44.936407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:44.946210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a4a74-ac3c-4036-8118-5c67fc14a37e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:44.954734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 482/977] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:44.980464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:44.981133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:44.981409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:44.981680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:44.982505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:44.982812 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:44.985017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c03f3-bc3e-4b40-84aa-d1a7d4032371 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:45.005965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 496/978] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:45.445151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e744f-eccf-4844-a97f-ad4229336086 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:45.446205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e744f-eccf-4844-a97f-ad4229336086 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:45.446687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e744f-eccf-4844-a97f-ad4229336086 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:45.449754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 483/979] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:45.455870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d3a5-dda8-464d-a3b4-ed78b7d44e96 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:45.456786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d3a5-dda8-464d-a3b4-ed78b7d44e96 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:45.457268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758d3a5-dda8-464d-a3b4-ed78b7d44e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:45.477395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5758d3a5-dda8-464d-a3b4-ed78b7d44e96 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:45.479453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5758d3a5-dda8-464d-a3b4-ed78b7d44e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:45.491927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 497/980] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:45 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:45.512833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e744f-eccf-4844-a97f-ad4229336086 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:45.526383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e744f-eccf-4844-a97f-ad4229336086 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:45.531308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d876-caf1-42f2-b1c1-0fb159dc63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:45.532274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d876-caf1-42f2-b1c1-0fb159dc63ea admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:45.532769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d876-caf1-42f2-b1c1-0fb159dc63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:45.533273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d876-caf1-42f2-b1c1-0fb159dc63ea admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:45.534256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594d876-caf1-42f2-b1c1-0fb159dc63ea admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:45.536162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594d876-caf1-42f2-b1c1-0fb159dc63ea admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:45.629406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 484/981] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:45 2022] POST /identity/v3/services => generated 242 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:46.763292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e150-fc03-425a-ba0b-378e6e20e67f None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:46.763878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e150-fc03-425a-ba0b-378e6e20e67f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:46.763960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e150-fc03-425a-ba0b-378e6e20e67f None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:46.766032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 498/982] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:46.771600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7353-7e05-4011-854d-67a019675856 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:46.772074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7353-7e05-4011-854d-67a019675856 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:46.772247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f7353-7e05-4011-854d-67a019675856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:46.792356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-884f7353-7e05-4011-854d-67a019675856 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:46.793571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-884f7353-7e05-4011-854d-67a019675856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:46.812805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 485/983] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:46 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:46.837139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e150-fc03-425a-ba0b-378e6e20e67f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:46.850400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e150-fc03-425a-ba0b-378e6e20e67f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:46.855184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7102-ccb6-4869-b070-e67554f8a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:46.855857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7102-ccb6-4869-b070-e67554f8a1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:46.856169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7102-ccb6-4869-b070-e67554f8a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:46.856450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7102-ccb6-4869-b070-e67554f8a1c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:46.857195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd7102-ccb6-4869-b070-e67554f8a1c5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:46.858793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd7102-ccb6-4869-b070-e67554f8a1c5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:46.926931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 499/984] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:46 2022] POST /identity/v3/services => generated 242 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:47.367712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2b9c-2a04-41db-aa13-bb80d3b09374 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.368033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2b9c-2a04-41db-aa13-bb80d3b09374 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.368306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e2b9c-2a04-41db-aa13-bb80d3b09374 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.370866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 486/985] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:47.376442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc31dc-4608-4160-a456-77b56a1b0bdc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.376733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc31dc-4608-4160-a456-77b56a1b0bdc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.377013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc31dc-4608-4160-a456-77b56a1b0bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.395685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-28bc31dc-4608-4160-a456-77b56a1b0bdc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:47.396916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-28bc31dc-4608-4160-a456-77b56a1b0bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:47.417545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 500/986] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:47 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:47.421940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f43ff5-b44e-4a11-b6ec-6a87856567ec None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.422231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f43ff5-b44e-4a11-b6ec-6a87856567ec None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.422508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f43ff5-b44e-4a11-b6ec-6a87856567ec None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.424546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 487/987] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:47.429775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.430065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.430339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.441372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f43ff5-b44e-4a11-b6ec-6a87856567ec None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.452888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:47.453351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f43ff5-b44e-4a11-b6ec-6a87856567ec None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.454895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:47.458078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.458908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.459195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.459465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.460137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.461724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.465469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 501/988] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:47 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:47.475794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 00:50:47.477464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 488/989] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:47.484199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.492716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.496375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90a66c-09c8-45d5-a798-08b8dd141c81 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.501056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.501734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.502018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.502292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.503004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:47.503311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.504939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.507665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb29a2-c4d3-4d79-8e6f-27d5898daf48 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.510970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 502/990] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:47.513622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.514525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.515005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.515774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.516457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.516941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.518950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.520482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.common [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 00:50:47.527260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab9e72-b886-42f2-8741-fc12734e1071 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.531349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.532040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.532326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.532609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.533321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:47.533630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.535272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.541303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 503/991] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:47.546870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.556400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a664a3-976a-4ccf-ba85-171335150e16 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.561510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.562142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.562434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.562711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.563491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] RBAC: Adding query filter params (interface=admin, service_id=cb6404ff8ff946ada1f096123f7248f8, region_id=RegionOne) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:47.563931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.565522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.570820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 504/992] 10.222.0.91 () {56 vars in 1270 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/endpoints?service_id=cb6404ff8ff946ada1f096123f7248f8&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:47.576751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.576886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.sql.core [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 21 00:50:47.576886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 21 00:50:47.576886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [parameters: {'user_id': '8ac1959dbaf84ea6a7f0403361bc1265', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 21 00:50:47.576886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79591) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 00:50:47.586543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ad2d6-2161-49b1-9dbf-364785d5d8bc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.592101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.592835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.593191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.593558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.594317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.596048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.596921 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 21 00:50:47.599875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 489/993] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 00:50:47 2022] POST /identity/v3/users => generated 160 bytes in 107 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:47.605852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.608637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 505/994] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/services => generated 1957 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 00:50:47.622376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349622c-0b2b-4adb-9744-63229b902c23 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.627532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.628423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.628965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.629197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.638749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.641145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.658094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c34637de-62a5-42d2-84ba-e88f4dc979b5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 00:50:47.659774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 490/995] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:47.665891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:47.677038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e9f7-0f67-4ae9-8eec-4f73b6d0cfbd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:47.682553 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:47.683283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:47.683571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:47.683861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:47.684820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:47.685129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:47.687155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6229c67f-1a1a-48ca-b924-26b5172350e1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:47.729407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 506/996] 10.222.0.91 () {56 vars in 1122 bytes} [Mon Feb 21 00:50:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:48.090919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401d8e9-aa69-40ca-962f-904f114f71d2 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.091504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401d8e9-aa69-40ca-962f-904f114f71d2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.091504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401d8e9-aa69-40ca-962f-904f114f71d2 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.096492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 491/997] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:48.101814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.102281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.102382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.120549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:48.121722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:48.129724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 507/998] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:48 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:48.154571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401d8e9-aa69-40ca-962f-904f114f71d2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:48.166991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401d8e9-aa69-40ca-962f-904f114f71d2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:48.171490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:48.172298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.172581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.172853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.173505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:48.175301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:48.186995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 00:50:48.188519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 492/999] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:48.194528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:48.204480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7080141-ceca-4335-941d-bf8ac714de41 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:48.209792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:48.210512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.210860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.211202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.212016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:48.212387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:48.214753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:48.221364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 508/1000] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:48.226425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:48.236939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c0158-45d7-46a8-9df3-d9c6ab56d6a0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:48.241542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:48.242183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.242461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.242734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.243459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:48.243816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:48.245416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:48.250680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 493/1001] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:48.256989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:48.267100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74611283-614b-4765-a619-7d0999f880b0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:48.271753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:48.272415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.272694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.272963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.273739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] RBAC: Adding query filter params (interface=public, service_id=08eb78e0e22b41879fd6026632f25e0b, region_id=RegionOne) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:48.274046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:48.276245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9518c8c-1210-442d-b81d-9b4ce361d1c3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:48.281343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 509/1002] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:48 2022] GET /identity/v3/endpoints?service_id=08eb78e0e22b41879fd6026632f25e0b&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:48.286986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:48.296852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ec989-37bf-441c-88ec-04e20527819e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:48.301391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936729c-f00e-4e6a-9a3c-44b6950e5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:48.302024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936729c-f00e-4e6a-9a3c-44b6950e5e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:48.302303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936729c-f00e-4e6a-9a3c-44b6950e5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:48.302576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936729c-f00e-4e6a-9a3c-44b6950e5e19 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:48.303244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936729c-f00e-4e6a-9a3c-44b6950e5e19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:48.304842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936729c-f00e-4e6a-9a3c-44b6950e5e19 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:48.311564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 494/1003] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:48 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 00:50:49.353851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120f32-c14e-45ff-99c9-8744067ad37c None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.354494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120f32-c14e-45ff-99c9-8744067ad37c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.354494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120f32-c14e-45ff-99c9-8744067ad37c None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.360544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 510/1004] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:49.367860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.367860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.367860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.387863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:49.391854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:49.404210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 495/1005] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:49 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:49.423137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2120f32-c14e-45ff-99c9-8744067ad37c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:49.436602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2120f32-c14e-45ff-99c9-8744067ad37c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:49.441254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:49.442038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.442320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.442591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.443247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:49.444887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:49.458521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 00:50:49.460043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 511/1006] 10.222.0.91 () {56 vars in 1126 bytes} [Mon Feb 21 00:50:49 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:49.466430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:49.476429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f64018-210d-4afd-937b-ad6d5e6e20c3 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:49.481910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:49.482607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.482891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.483167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.483910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:49.484222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:49.485845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:49.491362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 496/1007] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:49.498038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:49.507949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f82597-846d-44c6-b953-70f9ae0f51a5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:49.513043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:49.513725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.514011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.514292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.515031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] RBAC: Adding query filter params (type=image) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:49.515337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:49.517020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:49.527214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 512/1008] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:49.528512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:49.538814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d146a-1d03-410b-adef-a3c41bbd74e3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:49.548047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:49.548719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.548979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.549255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.550049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] RBAC: Adding query filter params (interface=public, service_id=fa5ee1dc1cd747cb804aa997f695f523, region_id=RegionOne) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:49.550362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:49.551990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf51f5d-b7fa-4ffe-b1f5-5866ab7f4294 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:49.559137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 497/1009] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:50:49 2022] GET /identity/v3/endpoints?service_id=fa5ee1dc1cd747cb804aa997f695f523&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:49.564304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:49.575986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0ec1c-a74e-4361-b80f-cbd4be949d6e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:49.580800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c53a5-bc2f-4628-8da5-13161375be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:49.581525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c53a5-bc2f-4628-8da5-13161375be07 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:49.581885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c53a5-bc2f-4628-8da5-13161375be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:49.582498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c53a5-bc2f-4628-8da5-13161375be07 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:49.583268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c53a5-bc2f-4628-8da5-13161375be07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:49.584962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c53a5-bc2f-4628-8da5-13161375be07 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:49.600335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 513/1010] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:50:49 2022] GET /identity/v3/services => generated 1957 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 00:50:50.035134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cceb5-e095-44d8-abce-c7771e765ada None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.035447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cceb5-e095-44d8-abce-c7771e765ada None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.035772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cceb5-e095-44d8-abce-c7771e765ada None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.037642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 498/1011] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:50.043186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.043483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.043770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.062518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:50.063717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:50.071949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 514/1012] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:50 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:50.096985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cceb5-e095-44d8-abce-c7771e765ada None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.109778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cceb5-e095-44d8-abce-c7771e765ada None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.114365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.115146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.115430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.115704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.116386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.118017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.129956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 00:50:50.131277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 499/1013] 10.222.0.91 () {56 vars in 1147 bytes} [Mon Feb 21 00:50:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:50.137982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.147472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26495e-dc52-4b34-96af-c54abdf8ee52 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.152561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.153216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.153502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.153780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.154493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:50.154800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.156454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.161636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 515/1014] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:50.167456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.177097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c678c93-65c4-49c0-b5bd-d9b03dc18455 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.182491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.183267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.183558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.183883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.184563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:50.184871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.186491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e738b43-64bf-4ad5-b310-d2f878bf792f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.191521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 500/1015] 10.222.0.91 () {56 vars in 1143 bytes} [Mon Feb 21 00:50:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:50.197465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.207693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5d8ea-471d-4900-adc1-e4982c2471eb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.212730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e16cd-9ee9-4ced-80aa-b2033b80b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.213599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e16cd-9ee9-4ced-80aa-b2033b80b106 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.213888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e16cd-9ee9-4ced-80aa-b2033b80b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.214172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e16cd-9ee9-4ced-80aa-b2033b80b106 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.214925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e16cd-9ee9-4ced-80aa-b2033b80b106 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.216612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e16cd-9ee9-4ced-80aa-b2033b80b106 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.325927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 516/1016] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:50.670043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f411d-8b64-4930-9de1-de7f3fc7bfc1 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.670563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f411d-8b64-4930-9de1-de7f3fc7bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.670563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f411d-8b64-4930-9de1-de7f3fc7bfc1 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.672366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 501/1017] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:50.677568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.678017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.678199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.700003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:50.701222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:50.718757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 517/1018] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:50 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:50.742988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f411d-8b64-4930-9de1-de7f3fc7bfc1 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.756705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f411d-8b64-4930-9de1-de7f3fc7bfc1 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.761787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.762617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.762893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.763212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.763894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.765477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.777483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 00:50:50.789302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 502/1019] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:50.789456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.794543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf37ba-98cf-45a2-b78c-d2833268fcdd None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.799203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.799958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.800320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.800664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.801490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:50.801858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.803557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.809255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 518/1020] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:50.814751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.825360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b002-8f9d-4539-9949-29f8d9ea2e45 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.829804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.830435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.830720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.830997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.831736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:50.832343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.833895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8dc41-6bc3-44ab-968e-295b4176298d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.838754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 503/1021] 10.222.0.91 () {56 vars in 1133 bytes} [Mon Feb 21 00:50:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:50.844140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:50.854090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caac78a-d43d-4ada-bbd0-d8f8aee16231 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:50.858681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9208d-c4c7-4672-8646-1b08bb7f6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:50.859388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9208d-c4c7-4672-8646-1b08bb7f6e01 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:50.859733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9208d-c4c7-4672-8646-1b08bb7f6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:50.860057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9208d-c4c7-4672-8646-1b08bb7f6e01 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:50.860827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9208d-c4c7-4672-8646-1b08bb7f6e01 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:50.862353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9208d-c4c7-4672-8646-1b08bb7f6e01 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:50.954954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 519/1022] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:52.005117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee15c-16fb-481b-8cfd-1f87a2a650a6 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.005789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee15c-16fb-481b-8cfd-1f87a2a650a6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.005789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbee15c-16fb-481b-8cfd-1f87a2a650a6 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.007610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 504/1023] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:52.013725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.014198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.014306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.154340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:52.155569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:52.175912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 520/1024] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:52 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:52.198187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbee15c-16fb-481b-8cfd-1f87a2a650a6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:52.211181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbee15c-16fb-481b-8cfd-1f87a2a650a6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:52.215928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:52.216718 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.216999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.217269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.217919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:52.219514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:52.230914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 00:50:52.232361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 505/1025] 10.222.0.91 () {56 vars in 1126 bytes} [Mon Feb 21 00:50:52 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:52.238022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:52.247574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137aea4e-7e52-4c0d-a289-6cef9270dc36 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:52.252229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:52.252944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.253241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.253438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.254138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] RBAC: Adding query filter params (name=image) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:52.254441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:52.256109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:52.262129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 521/1026] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:52.267619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:52.278296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67c212-f766-4c75-9b15-23609842f4c9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:52.282909 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:52.283558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.283859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.284163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.284872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:52.285180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:52.286797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad494-daf6-42a2-9b27-a410f9839e58 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:52.292822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 506/1027] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:52.298755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:52.309330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67641741-8b4a-4f6e-b2c8-d862703ad6eb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:52.313960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a887c-d139-4b36-b86e-1b7cee0aabc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:52.314604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a887c-d139-4b36-b86e-1b7cee0aabc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.314885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a887c-d139-4b36-b86e-1b7cee0aabc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.315162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a887c-d139-4b36-b86e-1b7cee0aabc4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.315941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a887c-d139-4b36-b86e-1b7cee0aabc4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:52.317511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a887c-d139-4b36-b86e-1b7cee0aabc4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:52.417532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 522/1028] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:50:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:50:52.762401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367dfc-3215-425c-a9ca-f5b34ad1d64c None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.762806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367dfc-3215-425c-a9ca-f5b34ad1d64c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.763021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367dfc-3215-425c-a9ca-f5b34ad1d64c None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.764978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 507/1029] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:52.770186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.770647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.771026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.789474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:52.791181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:52.810021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 523/1030] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:52.833667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367dfc-3215-425c-a9ca-f5b34ad1d64c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:52.846914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367dfc-3215-425c-a9ca-f5b34ad1d64c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:52.851366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2f224-9890-42da-9d80-41a0e26aabdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:52.852170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f224-9890-42da-9d80-41a0e26aabdc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.852453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f224-9890-42da-9d80-41a0e26aabdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.852731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2f224-9890-42da-9d80-41a0e26aabdc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.854473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f224-9890-42da-9d80-41a0e26aabdc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:52.856167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2f224-9890-42da-9d80-41a0e26aabdc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:52.857910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 508/1031] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:52.863521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:52.873468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1151ad7-563e-49b0-9faa-d3118720f465 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:52.878167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02faf278-c144-4518-ab76-ba650fa50402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:52.878877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faf278-c144-4518-ab76-ba650fa50402 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:52.879165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faf278-c144-4518-ab76-ba650fa50402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:52.879443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02faf278-c144-4518-ab76-ba650fa50402 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:52.880208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faf278-c144-4518-ab76-ba650fa50402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:52.882098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02faf278-c144-4518-ab76-ba650fa50402 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.030268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 524/1032] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:50:52 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:53.419123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956943-1563-44c7-a033-fd22de0a7488 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.419665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956943-1563-44c7-a033-fd22de0a7488 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.419665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79956943-1563-44c7-a033-fd22de0a7488 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.421654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 509/1033] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:53.426806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.427103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.427431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.446136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:53.447434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:53.505067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 525/1034] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:53.529224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79956943-1563-44c7-a033-fd22de0a7488 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.542130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79956943-1563-44c7-a033-fd22de0a7488 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.546555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.547340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.547621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.547943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.559432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:53.566821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 00:50:53.568262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 510/1035] 10.222.0.91 () {56 vars in 1141 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:53.574274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.584143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf35799-6233-4d7e-bf8c-cefe7b968195 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.589426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.590098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.590382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.590659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.591424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:53.591732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.593423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.602214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 526/1036] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:53.608432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.618169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055016-e639-4b49-8ca3-bd051cc0c604 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.623656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.624479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.624761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.625047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.635709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.637543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.656499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:53.659866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 511/1037] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:53.663910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.674696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fd9f6-f76e-4d21-8918-33f1b1ad8f03 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.679489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.680242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.680597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.680980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.682141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:53.682528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.684247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.696358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 527/1038] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:53.702124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.712704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284dc22-092e-4977-9396-c72a2fc3ea6e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.717400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.718219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.718554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.718828 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.726292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.728949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.742907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:53.744264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 512/1039] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:53.749775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.759693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439ceb4-b555-4c20-90c0-bc919004182b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.764403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.765133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.765507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.765849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.766762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:53.767144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.769097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.787241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 528/1040] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:53.793486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.803073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9c533-d76d-4a71-82f9-83ec2b2831cd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.808397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.809014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.809296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.809569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.817334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.819042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.831857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 513/1041] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:53.835390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.845530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf6b124-5e65-461b-8c1e-21af42dcd0cd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.850539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.851591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.852221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.852693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.863780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.865826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.883755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:53.886199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 529/1042] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:53.892404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.901753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543f6f7-8d3c-466c-a490-b99077ac1604 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.906379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.907380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.907668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.907986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.908709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:53.909017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.910639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.922871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 514/1043] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:53.928313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.939026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe2952-c563-4a6b-ac80-f1f8a1142962 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.943885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.944665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.944950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.945226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.953102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.955066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:53.969209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:53.970547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 530/1044] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:53.976337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:53.986847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72b5a-66e8-4174-9057-68b1f1d74f77 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:53.991680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:53.992430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:53.992793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:53.993145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:53.994662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:53.995069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:53.997056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb53125-3849-4a8e-95cd-6d003fbb2952 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:54.015872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 515/1045] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:54.019118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:54.034199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5217ef9-e158-4ef1-a33d-0211ede8ea02 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:54.042114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:54.043276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:54.043781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:54.044309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:54.045872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] RBAC: Adding query filter params (role.id=3c800633afdd49828ba4c2e676c38cc0, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=0d58bb9324d548b9b0e5fec7ae458a6a) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:54.046405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:54.049793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b31bf-044e-4157-8863-aaf973f07477 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:54.060413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 531/1046] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:54 2022] GET /identity/v3/role_assignments?user.id=0d58bb9324d548b9b0e5fec7ae458a6a&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=3c800633afdd49828ba4c2e676c38cc0 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:54.779279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a0459-a4e3-46b9-913b-bb92f0f125b0 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:54.779815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a0459-a4e3-46b9-913b-bb92f0f125b0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:54.779815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a0459-a4e3-46b9-913b-bb92f0f125b0 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:54.781660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 516/1047] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:54.787376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:54.787757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:54.788211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:54.807034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:54.808270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:54.816834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 532/1048] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:54.840780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a0459-a4e3-46b9-913b-bb92f0f125b0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:54.853478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a0459-a4e3-46b9-913b-bb92f0f125b0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:54.858019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be136f6e-7ef3-435e-b13f-0c93064e2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:54.858669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136f6e-7ef3-435e-b13f-0c93064e2f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:54.858949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136f6e-7ef3-435e-b13f-0c93064e2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:54.859222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be136f6e-7ef3-435e-b13f-0c93064e2f07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:54.867116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be136f6e-7ef3-435e-b13f-0c93064e2f07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:54.868990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be136f6e-7ef3-435e-b13f-0c93064e2f07 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:54.877918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 517/1049] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:54.883639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:54.893945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ec65f-c139-4d13-b597-30f9734dd8dc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:54.898564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bff511-bc80-4b49-b724-1c918f6999ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:54.899434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff511-bc80-4b49-b724-1c918f6999ef admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:54.900409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff511-bc80-4b49-b724-1c918f6999ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:54.900751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff511-bc80-4b49-b724-1c918f6999ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:54.902079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bff511-bc80-4b49-b724-1c918f6999ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:54.903823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bff511-bc80-4b49-b724-1c918f6999ef admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:54.906428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 533/1050] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:55.528687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643a17f-d1b2-4624-af3d-a02c6ad31492 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:55.528978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643a17f-d1b2-4624-af3d-a02c6ad31492 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:55.529259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643a17f-d1b2-4624-af3d-a02c6ad31492 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:55.531035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 518/1051] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:55.536395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:55.536846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:55.536939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:55.554918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:55.556757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:55.564530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 534/1052] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:55.589536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643a17f-d1b2-4624-af3d-a02c6ad31492 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:55.605384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643a17f-d1b2-4624-af3d-a02c6ad31492 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:55.609857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7efa0-0225-4440-b422-1678c740147e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:55.610575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7efa0-0225-4440-b422-1678c740147e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:55.610861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7efa0-0225-4440-b422-1678c740147e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:55.611144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7efa0-0225-4440-b422-1678c740147e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:55.612347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7efa0-0225-4440-b422-1678c740147e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:55.614023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7efa0-0225-4440-b422-1678c740147e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:55.615803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 519/1053] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:55.622210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:55.631435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08688b-26b4-486e-80d2-5cebb20a6617 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:55.636092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea6f6f-3789-404b-ad66-c09a3a2ac95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:55.636749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6f6f-3789-404b-ad66-c09a3a2ac95b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:55.637030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6f6f-3789-404b-ad66-c09a3a2ac95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:55.637309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea6f6f-3789-404b-ad66-c09a3a2ac95b admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:55.638033 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6f6f-3789-404b-ad66-c09a3a2ac95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:55.639995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea6f6f-3789-404b-ad66-c09a3a2ac95b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:55.779861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 535/1054] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:50:55 2022] POST /identity/v3/users => generated 285 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:50:56.516215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8592e-6d0c-4a86-8372-5388a827148e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.516743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8592e-6d0c-4a86-8372-5388a827148e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.516833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8592e-6d0c-4a86-8372-5388a827148e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.518562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 520/1055] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:56.523887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06353181-4626-4dc2-954c-64a48ade27da None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.524183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06353181-4626-4dc2-954c-64a48ade27da None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.524471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06353181-4626-4dc2-954c-64a48ade27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.542160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-06353181-4626-4dc2-954c-64a48ade27da None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:56.543321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-06353181-4626-4dc2-954c-64a48ade27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:56.550918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 536/1056] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:56.574302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8592e-6d0c-4a86-8372-5388a827148e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.586541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8592e-6d0c-4a86-8372-5388a827148e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.591322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.592136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.592418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.592743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.602635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:56.610656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 00:50:56.611782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 521/1057] 10.222.0.91 () {56 vars in 1141 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:56.617987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06353181-4626-4dc2-954c-64a48ade27da None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.627351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06353181-4626-4dc2-954c-64a48ade27da None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.631911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.632573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.632856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.633134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.633965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:56.634301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.635911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.646806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 537/1058] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:56.653149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.663394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fdb5d-d6e0-40f8-afa2-871d0498c268 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.668688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.669459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.669741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.670018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.680487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.682849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.700164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:56.701559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 522/1059] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:56.707418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.717315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54dd5-8930-46f5-9cec-18e1eeb51beb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.721880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.722527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.722811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.723089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.723808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:56.724144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.725723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.739864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 538/1060] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:56.746030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.755723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388747d-536e-44a5-8f88-9f9e4187d61d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.761049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.761807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.762091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.762368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.769737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.771717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.785455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:56.787070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 523/1061] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:56.793235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.802972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683596e7-1ce6-4dee-8322-e67d5aa296ca admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.808038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.808683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.808958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.809228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.810058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:56.810363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.812216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.830114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 539/1062] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:56.836094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.845620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab811e-8398-441f-a26c-0a5562cd8774 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.850176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.850932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.851215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.851489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.861858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.863654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.882579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:56.883802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 524/1063] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:56.890404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.900180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234f091-06ad-4c1c-9110-43096815d875 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.904826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.905471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.905755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.906032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.906758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:56.907063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.908691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.920421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 540/1064] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:56.925901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.936060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4568c-44e6-4c98-ad94-a3ba250690dc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.940551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.941318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.941599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.941871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.949739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.951702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:56.966197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:56.967423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 525/1065] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:56.973493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:56.983888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7327b3-db90-4a3e-9640-2fb85fc6fbe9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:56.988544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:56.989181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:56.989463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:56.989737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:56.990520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:56.990832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:56.992794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02b89d-0749-4e1d-a20f-af0e39e430da admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:57.005475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 541/1066] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:57.011784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:57.022047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa3a70-dcc7-4712-9842-ecdb3d4305af admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:57.026671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7eced-978b-4e19-9a23-a2d953d33721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:57.027519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7eced-978b-4e19-9a23-a2d953d33721 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:57.027796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7eced-978b-4e19-9a23-a2d953d33721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:57.028604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7eced-978b-4e19-9a23-a2d953d33721 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/0d58bb9324d548b9b0e5fec7ae458a6a/roles/3c800633afdd49828ba4c2e676c38cc0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:57.030373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7eced-978b-4e19-9a23-a2d953d33721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=0d58bb9324d548b9b0e5fec7ae458a6a, role_id=3c800633afdd49828ba4c2e676c38cc0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:57.033019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7eced-978b-4e19-9a23-a2d953d33721 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:57.119581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 526/1067] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:50:57 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/0d58bb9324d548b9b0e5fec7ae458a6a/roles/3c800633afdd49828ba4c2e676c38cc0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:50:58.153740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119196f-a7d0-4774-990c-efb35d38f3fd None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.154342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119196f-a7d0-4774-990c-efb35d38f3fd None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.154342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119196f-a7d0-4774-990c-efb35d38f3fd None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.156124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 542/1068] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:58.161646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.162078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.162191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.179941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:58.181740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:58.242534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 527/1069] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:50:58.268130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119196f-a7d0-4774-990c-efb35d38f3fd None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:58.280451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119196f-a7d0-4774-990c-efb35d38f3fd None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:58.284812 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:58.285576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.285853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.286121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.296320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:58.302998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:50:58.304198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 543/1070] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:58.310943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:58.319892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8ddd-d4cb-4b0c-bf9c-855bab618f05 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:58.325191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:58.325840 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.326127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.326406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.327156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:58.327462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:58.329127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:58.337903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 528/1071] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:58.343983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:58.354748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc7e8a-a174-4f04-8128-20184341632d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:58.361321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:58.362211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.362491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.362765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] PATH_INFO: `/v3/users/fe76c3d13cf64eac9408969915ff9ee3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.376659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe76c3d13cf64eac9408969915ff9ee3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:58.378775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:58.380451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 544/1072] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:50:58 2022] GET /identity/v3/users/fe76c3d13cf64eac9408969915ff9ee3 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:58.387311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:58.396931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4c81-acd8-42f2-af81-1af772d803db admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:58.401538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:58.402252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.402536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.402808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.410503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:58.412199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:58.421116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 529/1073] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:58.427342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:58.437693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4c106-070b-4394-94ab-f260ea0b6314 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:58.442197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed00941-b60d-4440-bf4a-980b24cec32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:58.443035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00941-b60d-4440-bf4a-980b24cec32e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.443318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00941-b60d-4440-bf4a-980b24cec32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.443594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed00941-b60d-4440-bf4a-980b24cec32e admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.444797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed00941-b60d-4440-bf4a-980b24cec32e admin admin] RBAC: Authorizing `identity:get_project(project_id=62b70de992bb4f6795793f5b3905f1ea)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:58.447488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed00941-b60d-4440-bf4a-980b24cec32e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:58.449174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 545/1074] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:50:58 2022] GET /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:58.455240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:58.465089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc620-c048-4262-85af-d9c889c21cd0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:58.469615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:58.470233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:58.470512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:58.470785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:58.471627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=62b70de992bb4f6795793f5b3905f1ea, user.id=fe76c3d13cf64eac9408969915ff9ee3) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:58.471972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:58.473784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042ce79-e9d4-432a-b18f-2b617cb3da47 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:58.479784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 530/1075] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:50:58 2022] GET /identity/v3/role_assignments?user.id=fe76c3d13cf64eac9408969915ff9ee3&scope.project.id=62b70de992bb4f6795793f5b3905f1ea&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:59.475774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b256-8282-4abc-81c4-eeaad3d61120 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.476326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b256-8282-4abc-81c4-eeaad3d61120 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.476448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b256-8282-4abc-81c4-eeaad3d61120 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.478847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 546/1076] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:50:59.484338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.484738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.484899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.503449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:50:59.504671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:50:59.512809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 531/1077] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:50:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:50:59.537004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b256-8282-4abc-81c4-eeaad3d61120 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.550632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b256-8282-4abc-81c4-eeaad3d61120 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.555334 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.557343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.557657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.558024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.568473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:50:59.580233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 00:50:59.581499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 547/1078] 10.222.0.91 () {56 vars in 1141 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:59.588949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.598106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f657af-9b81-4194-aabe-234b64ed19e7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.604421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.605111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.605392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.605667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.606434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:59.606793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.608425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.617559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 532/1079] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:59.623125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.633767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98928-d805-4405-8b1a-f4b85c735a6a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.638250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.639006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.639285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.639556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.650607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.652601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.669925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:59.671096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 548/1080] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:59.677028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.687077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c589-cbed-424d-8096-8e3e078cc1d1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.691732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.692449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.692736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.693016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.693753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:59.694064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.695658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.708393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 533/1081] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:59.715543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.725430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03869d9d-a012-4de0-b486-76f6aa97e5ea admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.730923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.731723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.732050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.732356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.739630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.741743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.755551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 00:50:59.756855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 549/1082] 10.222.0.91 () {56 vars in 1114 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:59.762656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.772951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f2c99-9fd8-4191-8ef1-83601db7c635 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.778586 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.779353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.779702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.780073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.781015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:59.781393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.783278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.801599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 534/1083] 10.222.0.91 () {56 vars in 1154 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:50:59.807373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.817167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a9b5a-e02e-48c9-bd50-e52dd5cbf2c0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.821821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.822395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.822664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.822935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.830731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.833842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.842302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 550/1084] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:50:59.847638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.858264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5365e-9c05-4130-b1fc-2520ecd1411b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.862986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.863750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.864080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.864361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.874673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.876619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.893053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:50:59.894421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 535/1085] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:50:59.903196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.912374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59791bf-f150-4497-8406-c8c6696ca0a1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.918550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.919284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.919644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.920023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.920820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:50:59.921197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.922883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.935322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 551/1086] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:50:59.941042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.951449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82517e7-af9e-4ac8-b77a-36209ba1bb28 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:50:59.955897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:50:59.956946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:50:59.957199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:50:59.957471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:50:59.964210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:50:59.966140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:50:59.979779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:50:59.980977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 536/1087] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:50:59.986797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:50:59.997673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811fbd-b2c9-4243-a326-fd533d756c5a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:00.002238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:00.002876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.003163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.003436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.004257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:00.004565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:00.006402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ada06-2802-4350-af77-68b715a3d9d5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:00.019193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 552/1088] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:51:00.025171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:00.035297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1deea-f767-4a30-9de2-55b7d00099d9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:00.039735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:00.040881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.041260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.041532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.042348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] RBAC: Adding query filter params (role.id=3c800633afdd49828ba4c2e676c38cc0, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=0d58bb9324d548b9b0e5fec7ae458a6a) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:00.042653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:00.044510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ae1c1-b26d-4d05-bd27-420ab3e7b605 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:00.050405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 537/1089] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:00 2022] GET /identity/v3/role_assignments?user.id=0d58bb9324d548b9b0e5fec7ae458a6a&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=3c800633afdd49828ba4c2e676c38cc0 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:00.833072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be822c03-ab82-41bf-9bd0-5b217a80a462 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.833592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be822c03-ab82-41bf-9bd0-5b217a80a462 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.833710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be822c03-ab82-41bf-9bd0-5b217a80a462 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.835444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 553/1090] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:00.842421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.842859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.842987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.861447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:00.862680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:00.871135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 538/1091] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:00.895986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be822c03-ab82-41bf-9bd0-5b217a80a462 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:00.909627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be822c03-ab82-41bf-9bd0-5b217a80a462 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:00.913996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:00.914764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.915562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.915885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.926173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:00.933455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:00.934630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 554/1092] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:00.940913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:00.950044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3dd8e-9b65-4124-958c-f2de3d0a9760 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:00.954617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:00.955270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.955555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.955853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.956873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:00.957188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:00.958762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:00.967537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 539/1093] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:00.973254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:00.984454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024837d-5fb5-4a23-a9ea-7cf9aeaa1116 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:00.989105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:00.989940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:00.990224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:00.990505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] PATH_INFO: `/v3/users/fe76c3d13cf64eac9408969915ff9ee3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:00.991698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe76c3d13cf64eac9408969915ff9ee3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:00.994689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:00.996753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 555/1094] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:00 2022] GET /identity/v3/users/fe76c3d13cf64eac9408969915ff9ee3 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:01.002189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:01.011595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648baf-3d21-46e1-9ed8-a2e54098a2be admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:01.016090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0663e11-39d1-4fdc-a016-6766b6169753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:01.016911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663e11-39d1-4fdc-a016-6766b6169753 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:01.017191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663e11-39d1-4fdc-a016-6766b6169753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:01.017464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0663e11-39d1-4fdc-a016-6766b6169753 admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:01.018736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0663e11-39d1-4fdc-a016-6766b6169753 admin admin] RBAC: Authorizing `identity:get_project(project_id=62b70de992bb4f6795793f5b3905f1ea)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:01.020834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0663e11-39d1-4fdc-a016-6766b6169753 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:01.022447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 540/1095] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:01 2022] GET /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:01.027850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:01.037280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b3ac-590b-45dd-9d48-98d08fa6a6d0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:01.042238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2da95-07bb-48d6-bcff-688e964f7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:01.043067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2da95-07bb-48d6-bcff-688e964f7507 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:01.043344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2da95-07bb-48d6-bcff-688e964f7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:01.043618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2da95-07bb-48d6-bcff-688e964f7507 admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea/users/fe76c3d13cf64eac9408969915ff9ee3/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:01.045550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2da95-07bb-48d6-bcff-688e964f7507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b70de992bb4f6795793f5b3905f1ea, user_id=fe76c3d13cf64eac9408969915ff9ee3, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:01.048157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2da95-07bb-48d6-bcff-688e964f7507 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:01.176091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 556/1096] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:51:01 2022] PUT /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea/users/fe76c3d13cf64eac9408969915ff9ee3/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:51:03.535079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d907-5bbd-4854-8ad7-a409d1df01d8 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.535627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d907-5bbd-4854-8ad7-a409d1df01d8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.535627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d907-5bbd-4854-8ad7-a409d1df01d8 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.537437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 541/1097] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:03.543551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.543999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.544138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.562023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:03.563224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:03.619939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 557/1098] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:03.644820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596d907-5bbd-4854-8ad7-a409d1df01d8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:03.657460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596d907-5bbd-4854-8ad7-a409d1df01d8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:03.661891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:03.662653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.662940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.663220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.673998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:03.681565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:03.682714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 542/1099] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:03.688565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:03.698152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d51d24-7fab-4d9a-99c2-072e7465cdbe None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:03.702638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:03.703279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.703561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.703854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.704615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:03.704918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:03.706740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:03.714990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 558/1100] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:03.720747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:03.731488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce4440-663d-42d1-b38f-b2516d79e1c0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:03.736060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:03.736957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.738010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.738010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] PATH_INFO: `/v3/users/fe76c3d13cf64eac9408969915ff9ee3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.738944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] RBAC: Authorizing `identity:get_user(user_id=fe76c3d13cf64eac9408969915ff9ee3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:03.741120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:03.743629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 543/1101] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:03 2022] GET /identity/v3/users/fe76c3d13cf64eac9408969915ff9ee3 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:03.749244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:03.759589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02bb71-3bd3-4c6d-8c09-ee52a7cf55c5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:03.764993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:03.765629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.766672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.766672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.774308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:03.776195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:03.785212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 559/1102] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:03.791741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:03.801271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a317a4-4c2b-49f4-ad1d-7080d373aa9d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:03.806465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a65e9e-a0fe-471a-9b5f-23244f3a0a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:03.807338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65e9e-a0fe-471a-9b5f-23244f3a0a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.807616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65e9e-a0fe-471a-9b5f-23244f3a0a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.807976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a65e9e-a0fe-471a-9b5f-23244f3a0a8d admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.809591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65e9e-a0fe-471a-9b5f-23244f3a0a8d admin admin] RBAC: Authorizing `identity:get_project(project_id=62b70de992bb4f6795793f5b3905f1ea)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:03.812039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a65e9e-a0fe-471a-9b5f-23244f3a0a8d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:03.813655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 544/1103] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:03 2022] GET /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:03.819416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:03.828371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65059c0-589b-4abc-af7c-adc3bda96dc1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:03.833205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:03.833825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:03.834107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:03.834385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:03.835206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=62b70de992bb4f6795793f5b3905f1ea, user.id=fe76c3d13cf64eac9408969915ff9ee3) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:03.835518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:03.837474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb295c1d-b6e4-4c79-b719-1b24f16a7d30 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:03.843229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 560/1104] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:03 2022] GET /identity/v3/role_assignments?user.id=fe76c3d13cf64eac9408969915ff9ee3&scope.project.id=62b70de992bb4f6795793f5b3905f1ea&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:06.301077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65333-45c3-4307-945b-2a26ad3f0c61 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:06.301615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65333-45c3-4307-945b-2a26ad3f0c61 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:06.301615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f65333-45c3-4307-945b-2a26ad3f0c61 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:06.303389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 545/1105] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:06.309200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:06.309600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:06.309768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:06.327269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:06.328487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:06.337018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 561/1106] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:06.362380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65333-45c3-4307-945b-2a26ad3f0c61 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:06.375113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f65333-45c3-4307-945b-2a26ad3f0c61 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:06.379434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1020369-fcba-4840-963c-b8fdaa822306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:06.380253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1020369-fcba-4840-963c-b8fdaa822306 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:06.380607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1020369-fcba-4840-963c-b8fdaa822306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:06.380883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1020369-fcba-4840-963c-b8fdaa822306 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:06.382052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1020369-fcba-4840-963c-b8fdaa822306 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:06.383732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1020369-fcba-4840-963c-b8fdaa822306 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:06.385432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 546/1107] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:51:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:06.391048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:06.400558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46499-77dd-4cc4-9a00-3b2febaebbc9 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:06.405086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b53b7-3d28-4860-8d2c-047a7564bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:06.405732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b53b7-3d28-4860-8d2c-047a7564bbcd admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:06.406013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b53b7-3d28-4860-8d2c-047a7564bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:06.406288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b53b7-3d28-4860-8d2c-047a7564bbcd admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:06.407373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b53b7-3d28-4860-8d2c-047a7564bbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:06.409342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b53b7-3d28-4860-8d2c-047a7564bbcd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:06.542546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 562/1108] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:51:06 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:51:08.885267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251991-1411-4b51-8f50-ffb5168ba5d2 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:08.885823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251991-1411-4b51-8f50-ffb5168ba5d2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:08.885823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e251991-1411-4b51-8f50-ffb5168ba5d2 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:08.887572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 547/1109] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:08.892939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:08.893352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:08.893492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:08.912172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:08.913371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:08.921517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 563/1110] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:08.947429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e251991-1411-4b51-8f50-ffb5168ba5d2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:08.962228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e251991-1411-4b51-8f50-ffb5168ba5d2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:08.966750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:08.967580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:08.967897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:08.968184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] PATH_INFO: `/v3/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:08.969660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] RBAC: Authorizing `identity:get_role(role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:08.970671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:51:08.970671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:51:08.970671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:51:08.971549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:08.972912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 548/1111] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:08 2022] GET /identity/v3/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:08.979351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:08.988643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d2597-6cca-4e80-81af-4e31d53b1c13 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:08.994160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:08.995004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:08.995287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:08.995573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] PATH_INFO: `/v3/users/df2888603bc744e4ab3f0c3f8770e997` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:09.009297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] RBAC: Authorizing `identity:get_user(user_id=df2888603bc744e4ab3f0c3f8770e997)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:09.011429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:09.013155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 564/1112] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:08 2022] GET /identity/v3/users/df2888603bc744e4ab3f0c3f8770e997 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:09.018824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:09.028860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c9edd-21cb-4e82-992c-6c58babb4808 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:09.033342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:09.033970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:09.034260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:09.034542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:09.043090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:09.044847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:09.053605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 549/1113] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:09.060143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:09.069680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaee50e-6905-402d-adb6-821e705bb1da admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:09.074284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d3ed0-d1e1-43bd-8353-d23fc17f2089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:09.075106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d3ed0-d1e1-43bd-8353-d23fc17f2089 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:09.075384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d3ed0-d1e1-43bd-8353-d23fc17f2089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:09.075656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d3ed0-d1e1-43bd-8353-d23fc17f2089 admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:09.076859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d3ed0-d1e1-43bd-8353-d23fc17f2089 admin admin] RBAC: Authorizing `identity:get_project(project_id=62b70de992bb4f6795793f5b3905f1ea)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:09.078871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d3ed0-d1e1-43bd-8353-d23fc17f2089 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:09.080519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 565/1114] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:09 2022] GET /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:09.087297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:09.096033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e5cbc-9970-4d53-b00b-204e4e597bb9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:09.100738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:09.101364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:09.101653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:09.102576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:09.103730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] RBAC: Adding query filter params (role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=62b70de992bb4f6795793f5b3905f1ea, user.id=df2888603bc744e4ab3f0c3f8770e997) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:09.104082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:09.105900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d358c2c-74fd-4688-ae80-e249eac28fc1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:09.111331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 550/1115] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:09 2022] GET /identity/v3/role_assignments?user.id=df2888603bc744e4ab3f0c3f8770e997&scope.project.id=62b70de992bb4f6795793f5b3905f1ea&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:51:11.402202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b5d05-5453-45b2-b654-4fa446506d02 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:11.402691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b5d05-5453-45b2-b654-4fa446506d02 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:11.402780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b5d05-5453-45b2-b654-4fa446506d02 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:11.404573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 566/1116] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:11.409986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:11.410395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:11.410548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:11.428298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:11.429508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:11.437409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 551/1117] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:51:11.460985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b5d05-5453-45b2-b654-4fa446506d02 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:11.473787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b5d05-5453-45b2-b654-4fa446506d02 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:11.478836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:11.479657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:11.480002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:11.480282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] PATH_INFO: `/v3/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:11.481742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] RBAC: Authorizing `identity:get_role(role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:11.482749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:51:11.482749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 00:51:11.482749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 00:51:11.483652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:11.484989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 567/1118] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:11 2022] GET /identity/v3/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:11.490468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:11.499929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2b0c-4acf-4693-a0b7-69a72027d40b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:11.504372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:11.505211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:11.505489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:11.505762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] PATH_INFO: `/v3/users/df2888603bc744e4ab3f0c3f8770e997` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:11.506934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] RBAC: Authorizing `identity:get_user(user_id=df2888603bc744e4ab3f0c3f8770e997)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:11.509201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:11.510750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 552/1119] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:11 2022] GET /identity/v3/users/df2888603bc744e4ab3f0c3f8770e997 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:11.516147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:11.526165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c0da-4727-4fee-ac4f-fd1d01dd59e5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:11.530798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b69e6-ab9b-4924-abc2-70dda413f07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:11.531628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b69e6-ab9b-4924-abc2-70dda413f07a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:11.531943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b69e6-ab9b-4924-abc2-70dda413f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:11.532226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b69e6-ab9b-4924-abc2-70dda413f07a admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:11.533389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b69e6-ab9b-4924-abc2-70dda413f07a admin admin] RBAC: Authorizing `identity:get_project(project_id=62b70de992bb4f6795793f5b3905f1ea)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:11.535392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b69e6-ab9b-4924-abc2-70dda413f07a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:11.537045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 568/1120] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:11 2022] GET /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:11.543171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:11.552436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67b92-19ef-40f1-8228-a5df31047f19 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:11.557595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293d09f-0b4e-4fe5-a339-903ca3a8abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:11.558428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d09f-0b4e-4fe5-a339-903ca3a8abc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:11.558705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d09f-0b4e-4fe5-a339-903ca3a8abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:11.558977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293d09f-0b4e-4fe5-a339-903ca3a8abc0 admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea/users/df2888603bc744e4ab3f0c3f8770e997/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:11.561194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293d09f-0b4e-4fe5-a339-903ca3a8abc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b70de992bb4f6795793f5b3905f1ea, user_id=df2888603bc744e4ab3f0c3f8770e997, role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:11.563754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293d09f-0b4e-4fe5-a339-903ca3a8abc0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:11.679078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 553/1121] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:51:11 2022] PUT /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea/users/df2888603bc744e4ab3f0c3f8770e997/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:51:14.022203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366291-7a62-4cd9-9981-eecac3277920 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.022743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366291-7a62-4cd9-9981-eecac3277920 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.022743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366291-7a62-4cd9-9981-eecac3277920 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.025202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 569/1122] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:14.030427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.030811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.030995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.049015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:14.050195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:14.106473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 554/1123] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:14.130975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366291-7a62-4cd9-9981-eecac3277920 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:14.144064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366291-7a62-4cd9-9981-eecac3277920 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:14.149452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:14.150360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.150649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.150921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] PATH_INFO: `/v3/roles/7443fb7779b14c6dbce1fed0009cbd20` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.152430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] RBAC: Authorizing `identity:get_role(role_id=7443fb7779b14c6dbce1fed0009cbd20)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:14.154022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:14.155344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 570/1124] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:14 2022] GET /identity/v3/roles/7443fb7779b14c6dbce1fed0009cbd20 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:14.160930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:14.170643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0e44-beb0-4f07-8848-a68cb0a2f4d2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:14.175193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:14.176197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.176483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.176760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] PATH_INFO: `/v3/users/df2888603bc744e4ab3f0c3f8770e997` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.177957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] RBAC: Authorizing `identity:get_user(user_id=df2888603bc744e4ab3f0c3f8770e997)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:14.180162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:14.181721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 555/1125] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:14 2022] GET /identity/v3/users/df2888603bc744e4ab3f0c3f8770e997 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:14.187277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:14.197222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1d9c-8aec-4a89-8197-7ffb83f19ade admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:14.201748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:14.202359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.202641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.202912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.210715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:14.213035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:14.221688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 571/1126] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:14.227912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:14.237468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05b66a-6b4e-4689-b482-23915d4a8e75 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:14.242043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a703a5-4c20-43ce-81ec-0d572a0df8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:14.243131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a703a5-4c20-43ce-81ec-0d572a0df8fb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.243418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a703a5-4c20-43ce-81ec-0d572a0df8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.243699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a703a5-4c20-43ce-81ec-0d572a0df8fb admin admin] PATH_INFO: `/v3/projects/62b70de992bb4f6795793f5b3905f1ea` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.244921 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a703a5-4c20-43ce-81ec-0d572a0df8fb admin admin] RBAC: Authorizing `identity:get_project(project_id=62b70de992bb4f6795793f5b3905f1ea)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:14.247008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a703a5-4c20-43ce-81ec-0d572a0df8fb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:14.248674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 556/1127] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:14 2022] GET /identity/v3/projects/62b70de992bb4f6795793f5b3905f1ea => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:14.254246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:14.263333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d9358-941b-46b5-b8c4-8e9c124f821c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:14.267847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:14.268468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:14.268747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:14.269022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:14.269831 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] RBAC: Adding query filter params (role.id=7443fb7779b14c6dbce1fed0009cbd20, scope.project.id=62b70de992bb4f6795793f5b3905f1ea, user.id=df2888603bc744e4ab3f0c3f8770e997) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:14.270138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:14.272030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56028929-0f7c-464c-b93c-3ecee8c1523a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:14.278547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 572/1128] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:14 2022] GET /identity/v3/role_assignments?user.id=df2888603bc744e4ab3f0c3f8770e997&scope.project.id=62b70de992bb4f6795793f5b3905f1ea&role.id=7443fb7779b14c6dbce1fed0009cbd20 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:16.596215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694f5b-e514-4460-a5a2-fbf5890a712e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:16.596735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694f5b-e514-4460-a5a2-fbf5890a712e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:16.596847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87694f5b-e514-4460-a5a2-fbf5890a712e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:16.598538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 557/1129] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:16.604859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:16.605282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:16.605423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:16.626127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:16.626127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:16.633625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 573/1130] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:16.657571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87694f5b-e514-4460-a5a2-fbf5890a712e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:16.670160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87694f5b-e514-4460-a5a2-fbf5890a712e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:16.674519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a82f72-c07f-4fa0-bdc7-aa53a39dac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:16.675274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82f72-c07f-4fa0-bdc7-aa53a39dac5e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:16.675557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82f72-c07f-4fa0-bdc7-aa53a39dac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:16.675920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a82f72-c07f-4fa0-bdc7-aa53a39dac5e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:16.677065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82f72-c07f-4fa0-bdc7-aa53a39dac5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:16.678711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a82f72-c07f-4fa0-bdc7-aa53a39dac5e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:16.681146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 558/1131] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:51:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:51:16.686747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:16.695666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e7f75-05a1-4ba5-9633-0a9df27e9aa6 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:16.700383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfe7fc-e6e7-435e-ba9c-d22a2519bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:16.701018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe7fc-e6e7-435e-ba9c-d22a2519bdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:16.701298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe7fc-e6e7-435e-ba9c-d22a2519bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:16.701573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfe7fc-e6e7-435e-ba9c-d22a2519bdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:16.702273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfe7fc-e6e7-435e-ba9c-d22a2519bdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:16.704307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfe7fc-e6e7-435e-ba9c-d22a2519bdd7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:16.787843 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 574/1132] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:51:16 2022] POST /identity/v3/projects => generated 311 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:51:19.128511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c805a-03ff-4adf-81cb-dc5efc1aca82 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:19.129061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c805a-03ff-4adf-81cb-dc5efc1aca82 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:19.129061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c805a-03ff-4adf-81cb-dc5efc1aca82 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:19.130819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 559/1133] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:19.136678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:19.137086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:19.137261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:19.154525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:19.155690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:19.212376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 575/1134] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:19.238241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c805a-03ff-4adf-81cb-dc5efc1aca82 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:19.251116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c805a-03ff-4adf-81cb-dc5efc1aca82 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:19.255512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fece80-78c5-45bb-9261-1e90af926021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:19.256320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fece80-78c5-45bb-9261-1e90af926021 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:19.256605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fece80-78c5-45bb-9261-1e90af926021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:19.256884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fece80-78c5-45bb-9261-1e90af926021 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:19.258817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fece80-78c5-45bb-9261-1e90af926021 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:19.260511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fece80-78c5-45bb-9261-1e90af926021 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:19.262061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 560/1135] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:19.267574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:19.278309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cfdb3-9cfd-477c-97e3-583d5f9ca5b8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:19.283055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83735cc6-b3ab-4d23-bbd9-906a0d09dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:19.283704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735cc6-b3ab-4d23-bbd9-906a0d09dbba admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:19.284026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735cc6-b3ab-4d23-bbd9-906a0d09dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:19.284307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83735cc6-b3ab-4d23-bbd9-906a0d09dbba admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:19.285022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735cc6-b3ab-4d23-bbd9-906a0d09dbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:19.286932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83735cc6-b3ab-4d23-bbd9-906a0d09dbba admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:19.411202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 576/1136] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:51:19 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:51:21.793289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e00b5-1da2-4527-9f05-2014f0e851f8 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:21.793880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e00b5-1da2-4527-9f05-2014f0e851f8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:21.793880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e00b5-1da2-4527-9f05-2014f0e851f8 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:21.795635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 561/1137] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:21.800883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:21.801289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:21.801450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:21.819190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:21.821075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:21.828866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 577/1138] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:21.853861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e00b5-1da2-4527-9f05-2014f0e851f8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:21.865854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e00b5-1da2-4527-9f05-2014f0e851f8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:21.870637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:21.871430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:21.871714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:21.872020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:21.881953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:21.889304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:21.890450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 562/1139] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:21.896382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:21.906232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1dadd-6011-4ee2-98db-58200b10b7a2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:21.910853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:21.911500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:21.911787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:21.912100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:21.912853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:21.913161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:21.914961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:21.923260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 578/1140] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:21.930910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:21.942198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd4a1f-3358-435d-a949-36702d726512 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:21.947661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:21.948560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:21.948846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:21.949275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] PATH_INFO: `/v3/users/afde23a00d664fa3b1d1bc0dab111da2` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:21.963208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] RBAC: Authorizing `identity:get_user(user_id=afde23a00d664fa3b1d1bc0dab111da2)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:21.965367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:21.967166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 563/1141] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:21 2022] GET /identity/v3/users/afde23a00d664fa3b1d1bc0dab111da2 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:21.973068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:21.983154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15773616-b2dd-4766-bb20-505e1b38e726 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:21.987694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:21.988351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:21.988639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:21.988918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:21.997179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:21.998902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:22.008858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 579/1142] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:22.014564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:22.024716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465e2d-db1b-4b81-98e8-758b2b890d69 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:22.029207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c6011-84e4-43c6-993d-07c2952a9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:22.030032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6011-84e4-43c6-993d-07c2952a9139 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:22.030316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6011-84e4-43c6-993d-07c2952a9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:22.030589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c6011-84e4-43c6-993d-07c2952a9139 admin admin] PATH_INFO: `/v3/projects/43074291d6754faab6333055ebf1951c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:22.031750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c6011-84e4-43c6-993d-07c2952a9139 admin admin] RBAC: Authorizing `identity:get_project(project_id=43074291d6754faab6333055ebf1951c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:22.033791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c6011-84e4-43c6-993d-07c2952a9139 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:22.035404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 564/1143] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:22 2022] GET /identity/v3/projects/43074291d6754faab6333055ebf1951c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:22.041427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:22.050146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c86f8-153f-4f23-ad88-24dae5add165 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:22.055908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:22.055908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:22.055908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:22.056214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:22.056805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=43074291d6754faab6333055ebf1951c, user.id=afde23a00d664fa3b1d1bc0dab111da2) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:22.057111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:22.058929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563b5cc-0b67-4a35-bc36-825407b381dc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:22.064447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 580/1144] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:22 2022] GET /identity/v3/role_assignments?user.id=afde23a00d664fa3b1d1bc0dab111da2&scope.project.id=43074291d6754faab6333055ebf1951c&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:24.311317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40938a-e5a3-4f18-a432-37b0e863c8a7 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.311914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40938a-e5a3-4f18-a432-37b0e863c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.311914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40938a-e5a3-4f18-a432-37b0e863c8a7 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.313707 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 565/1145] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:24.318915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.319348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.319471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.338322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:24.339484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:24.347034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 581/1146] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:51:24.370532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40938a-e5a3-4f18-a432-37b0e863c8a7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:24.383478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40938a-e5a3-4f18-a432-37b0e863c8a7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:24.387854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:24.388615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.388892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.389161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.399276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:24.406017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:24.407481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 566/1147] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:24.413207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:24.422435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72e9bf-5a98-4654-a34c-d7c9d0b414c3 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:24.426901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:24.427536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.427817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.428118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.428865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:24.429743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:24.431400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:24.439379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 582/1148] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:24.445763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:24.456104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f5ef-9aa2-42d0-902e-a47fbc3cc8b3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:24.460584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:24.461407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.461687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.461962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] PATH_INFO: `/v3/users/afde23a00d664fa3b1d1bc0dab111da2` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.463161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] RBAC: Authorizing `identity:get_user(user_id=afde23a00d664fa3b1d1bc0dab111da2)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:24.465271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:24.466807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 567/1149] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:24 2022] GET /identity/v3/users/afde23a00d664fa3b1d1bc0dab111da2 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:24.472410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:24.482043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cdfd1-c064-4866-87ac-6ae5924ccfd7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:24.486628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ff15d-ed29-46c6-a276-411542b239ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:24.487452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff15d-ed29-46c6-a276-411542b239ff admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.487736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff15d-ed29-46c6-a276-411542b239ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.488049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff15d-ed29-46c6-a276-411542b239ff admin admin] PATH_INFO: `/v3/projects/43074291d6754faab6333055ebf1951c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.489226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ff15d-ed29-46c6-a276-411542b239ff admin admin] RBAC: Authorizing `identity:get_project(project_id=43074291d6754faab6333055ebf1951c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:24.491248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ff15d-ed29-46c6-a276-411542b239ff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:24.493392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 583/1150] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:24 2022] GET /identity/v3/projects/43074291d6754faab6333055ebf1951c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:24.498989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:24.508942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaeaef-66f1-47ab-a995-c47d677f1b0c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:24.513440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d345e3-8bfe-4552-ac28-266547c8ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:24.514278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d345e3-8bfe-4552-ac28-266547c8ed02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:24.514560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d345e3-8bfe-4552-ac28-266547c8ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:24.514830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d345e3-8bfe-4552-ac28-266547c8ed02 admin admin] PATH_INFO: `/v3/projects/43074291d6754faab6333055ebf1951c/users/afde23a00d664fa3b1d1bc0dab111da2/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:24.516808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d345e3-8bfe-4552-ac28-266547c8ed02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43074291d6754faab6333055ebf1951c, user_id=afde23a00d664fa3b1d1bc0dab111da2, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:24.519367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d345e3-8bfe-4552-ac28-266547c8ed02 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:24.602035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 568/1151] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:51:24 2022] PUT /identity/v3/projects/43074291d6754faab6333055ebf1951c/users/afde23a00d664fa3b1d1bc0dab111da2/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 00:51:26.900482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65839d-8308-4779-87c5-ada44c931653 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:26.901035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65839d-8308-4779-87c5-ada44c931653 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:26.901035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65839d-8308-4779-87c5-ada44c931653 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:26.902776 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 584/1152] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:26.907992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:26.908403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:26.908557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:26.926088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:26.927393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:26.984331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 569/1153] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:51:27.008495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65839d-8308-4779-87c5-ada44c931653 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:27.020461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65839d-8308-4779-87c5-ada44c931653 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:27.024892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:27.025660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:27.025930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:27.026205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:27.036187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:27.043381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:27.044545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 585/1154] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:51:27.050449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:27.059960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88093c06-9913-4f99-81de-c80a4147b2b9 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:27.064426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:27.065186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:27.065470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:27.065744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:27.066489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:27.066793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:27.068406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:27.076683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 570/1155] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:27.082589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:27.092786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a5ab-6459-4332-b76b-e73a69e82b3c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:27.097434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:27.098267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:27.098551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:27.098889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] PATH_INFO: `/v3/users/afde23a00d664fa3b1d1bc0dab111da2` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:27.100099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] RBAC: Authorizing `identity:get_user(user_id=afde23a00d664fa3b1d1bc0dab111da2)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:27.102780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:27.104368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 586/1156] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:27 2022] GET /identity/v3/users/afde23a00d664fa3b1d1bc0dab111da2 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:27.109941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:27.120059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088302f-b3a7-46ea-95d4-236999f73ce8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:27.124588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:27.125202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:27.125485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:27.125788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:27.133588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:27.135309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:27.144191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 571/1157] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:27.150153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:27.159763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e9f95-feb5-4085-b88f-a321ebc6ba6c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:27.164869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca820d6-7b3f-4c99-b9e9-cce4f02ce5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:27.165686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca820d6-7b3f-4c99-b9e9-cce4f02ce5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:27.165964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca820d6-7b3f-4c99-b9e9-cce4f02ce5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:27.166237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca820d6-7b3f-4c99-b9e9-cce4f02ce5e9 admin admin] PATH_INFO: `/v3/projects/43074291d6754faab6333055ebf1951c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:27.167380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca820d6-7b3f-4c99-b9e9-cce4f02ce5e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=43074291d6754faab6333055ebf1951c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:27.169438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca820d6-7b3f-4c99-b9e9-cce4f02ce5e9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:27.171068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 587/1158] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:27 2022] GET /identity/v3/projects/43074291d6754faab6333055ebf1951c => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:27.176760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:27.186060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340a198-d0d6-4df4-9668-28ec45f2735a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:27.190675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:27.191292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:27.191574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:27.191881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:27.192706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=43074291d6754faab6333055ebf1951c, user.id=afde23a00d664fa3b1d1bc0dab111da2) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:27.193009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:27.194928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6c2dd-a88b-4b99-b315-60e000952cdc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:27.200901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 572/1159] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:27 2022] GET /identity/v3/role_assignments?user.id=afde23a00d664fa3b1d1bc0dab111da2&scope.project.id=43074291d6754faab6333055ebf1951c&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:29.517547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b67d0-a202-4fa8-9f85-f2be626e3e6a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:29.518128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b67d0-a202-4fa8-9f85-f2be626e3e6a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:29.518221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b67d0-a202-4fa8-9f85-f2be626e3e6a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:29.520045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 588/1160] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:29.525950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:29.526420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:29.526525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:29.544348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:29.545593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:29.553386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 573/1161] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:29.576565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b67d0-a202-4fa8-9f85-f2be626e3e6a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:29.590204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b67d0-a202-4fa8-9f85-f2be626e3e6a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:29.594641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:29.595269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:29.595551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:29.595849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:29.603753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:29.605507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:29.614416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 589/1162] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:29.620803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:29.629699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff9d2-8e92-4ddf-ad30-f5d36946f18c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:29.634824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:29.635598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:29.635910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:29.636271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:29.643272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:29.645133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:29.660097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-716e8f4b-3382-40f8-a256-bffce294b20e admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 21 00:51:29.661278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 574/1163] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:51:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:29.667556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:29.676780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff730-31f6-4ae0-8b9f-b62600e9ac19 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:29.682125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:29.682759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:29.683044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:29.683323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:29.684111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:29.684420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:29.686010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59e385-86b1-4c19-b18b-da45f74fb03f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:29.693225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 590/1164] 10.222.0.91 () {56 vars in 1136 bytes} [Mon Feb 21 00:51:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:31.974595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3835ec-1050-4d7b-87fd-f7052ed9c963 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:31.975152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3835ec-1050-4d7b-87fd-f7052ed9c963 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:31.975152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3835ec-1050-4d7b-87fd-f7052ed9c963 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:31.977089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 575/1165] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:31.982368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa3b3-0ff9-4ab7-b7a9-dea4fac2676b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:31.982800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa3b3-0ff9-4ab7-b7a9-dea4fac2676b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:31.982936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa3b3-0ff9-4ab7-b7a9-dea4fac2676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:32.001848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-201fa3b3-0ff9-4ab7-b7a9-dea4fac2676b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:32.003986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-201fa3b3-0ff9-4ab7-b7a9-dea4fac2676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:32.017948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 591/1166] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:32.041414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3835ec-1050-4d7b-87fd-f7052ed9c963 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:32.053507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3835ec-1050-4d7b-87fd-f7052ed9c963 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:32.058568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:32.059198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:32.059479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:32.059752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:32.060521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:32.061587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 00:51:32.061587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 00:51:32.061587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 00:51:32.062449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdf9f9-de19-414f-ae9d-4307a7c7d0a9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:32.157399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 576/1167] 10.222.0.91 () {60 vars in 1159 bytes} [Mon Feb 21 00:51:32 2022] POST /identity/v3/domains => generated 267 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:51:34.557994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c3b9-873f-4395-99db-71ddaf6a70c9 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:34.558520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c3b9-873f-4395-99db-71ddaf6a70c9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:34.558520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c3b9-873f-4395-99db-71ddaf6a70c9 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:34.560354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 592/1168] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:34.565474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:34.565854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:34.566041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:34.584183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:34.585689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:34.642354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 577/1169] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:34.667536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c3b9-873f-4395-99db-71ddaf6a70c9 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:34.680789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51c3b9-873f-4395-99db-71ddaf6a70c9 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:34.685259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38f4d1-9653-43a1-9998-6363be3baa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:34.686098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f4d1-9653-43a1-9998-6363be3baa9e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:34.686386 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f4d1-9653-43a1-9998-6363be3baa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:34.686664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38f4d1-9653-43a1-9998-6363be3baa9e admin admin] PATH_INFO: `/v3/domains/6a3ce9155483403ea7efb5aaed548816` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:34.697538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f4d1-9653-43a1-9998-6363be3baa9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6a3ce9155483403ea7efb5aaed548816)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:34.699494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38f4d1-9653-43a1-9998-6363be3baa9e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:34.701120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 593/1170] 10.222.0.91 () {56 vars in 1204 bytes} [Mon Feb 21 00:51:34 2022] GET /identity/v3/domains/6a3ce9155483403ea7efb5aaed548816 => generated 267 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:34.707130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:34.716013 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bfb0-9425-4f31-b530-4a8711cf322e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:34.720477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0130-0e07-4469-94e3-5f04dc04a088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:34.721113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0130-0e07-4469-94e3-5f04dc04a088 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:34.721396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0130-0e07-4469-94e3-5f04dc04a088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:34.721667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0130-0e07-4469-94e3-5f04dc04a088 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:34.722378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0130-0e07-4469-94e3-5f04dc04a088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:34.724330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0130-0e07-4469-94e3-5f04dc04a088 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:34.811049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 578/1171] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:51:34 2022] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 00:51:37.103213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d593c-cb59-4bec-938c-4eaa9fe7db1c None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:37.103749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d593c-cb59-4bec-938c-4eaa9fe7db1c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:37.103749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d593c-cb59-4bec-938c-4eaa9fe7db1c None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:37.105544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 594/1172] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:37.110920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:37.111349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:37.111484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:37.131065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:37.133006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:37.189156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 579/1173] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:51:37.215768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d593c-cb59-4bec-938c-4eaa9fe7db1c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:37.228108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d593c-cb59-4bec-938c-4eaa9fe7db1c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:37.232552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3544a-20f4-490a-931d-6dacd64bdcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:37.233383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3544a-20f4-490a-931d-6dacd64bdcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:37.233669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3544a-20f4-490a-931d-6dacd64bdcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:37.233949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3544a-20f4-490a-931d-6dacd64bdcb9 admin admin] PATH_INFO: `/v3/domains/6a3ce9155483403ea7efb5aaed548816` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:37.235157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3544a-20f4-490a-931d-6dacd64bdcb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=6a3ce9155483403ea7efb5aaed548816)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:37.237187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3544a-20f4-490a-931d-6dacd64bdcb9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:37.238741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 595/1174] 10.222.0.91 () {56 vars in 1204 bytes} [Mon Feb 21 00:51:37 2022] GET /identity/v3/domains/6a3ce9155483403ea7efb5aaed548816 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:37.244878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:37.253683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b599a-c296-4dc9-acaf-bd280eea36e0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:37.258712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5ef04-1327-4365-8b45-3ac2783b9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:37.259495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ef04-1327-4365-8b45-3ac2783b9c40 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:37.259780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ef04-1327-4365-8b45-3ac2783b9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:37.260089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5ef04-1327-4365-8b45-3ac2783b9c40 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:37.260800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5ef04-1327-4365-8b45-3ac2783b9c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:37.262696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5ef04-1327-4365-8b45-3ac2783b9c40 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:37.380715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 580/1175] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:51:37 2022] POST /identity/v3/users => generated 311 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:51:39.760225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495f34-76c4-4086-9461-0919b2ee9f46 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.760753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495f34-76c4-4086-9461-0919b2ee9f46 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.760875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495f34-76c4-4086-9461-0919b2ee9f46 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.762601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 596/1176] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:39.767981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.768420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.768545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.787268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:39.789049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:39.796738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 581/1177] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:39.820410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74495f34-76c4-4086-9461-0919b2ee9f46 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:39.832691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74495f34-76c4-4086-9461-0919b2ee9f46 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:39.837407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:39.838171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.838455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.838733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.849308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:39.856824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:39.857971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 597/1178] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:39.864009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:39.873733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6224-b345-4f44-8658-a58211063d61 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:39.878426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:39.879079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.879367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.879648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.880442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:39.880756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:39.882741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:39.891047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 582/1179] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:39.896633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:39.906230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5682-765b-4801-9792-015d1adc5649 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:39.910848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:39.911678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.912005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.912286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] PATH_INFO: `/v3/users/c12b2db7e7354d5690eefc7bbb6f977d` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.926047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=c12b2db7e7354d5690eefc7bbb6f977d)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:39.928808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:39.930434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 598/1180] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:39 2022] GET /identity/v3/users/c12b2db7e7354d5690eefc7bbb6f977d => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:39.936106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:39.945772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2b92b-c0f5-4725-acb3-05ecdeab4353 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:39.950399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:39.951018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.951311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.951593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.959601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:39.961263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:39.969971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 583/1181] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 00:51:39.976116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:39.985607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d7b0-fa90-407a-bf7a-7110a2e849e0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:39.990217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5bce-e3b9-49d6-9c97-1d68de509a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:39.991669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5bce-e3b9-49d6-9c97-1d68de509a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:39.991948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5bce-e3b9-49d6-9c97-1d68de509a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:39.992225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5bce-e3b9-49d6-9c97-1d68de509a2b admin admin] PATH_INFO: `/v3/projects/ec8970206985408597da37fc46a04f8c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:39.993387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5bce-e3b9-49d6-9c97-1d68de509a2b admin admin] RBAC: Authorizing `identity:get_project(project_id=ec8970206985408597da37fc46a04f8c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:39.995446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5bce-e3b9-49d6-9c97-1d68de509a2b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:39.997093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 599/1182] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:39 2022] GET /identity/v3/projects/ec8970206985408597da37fc46a04f8c => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:40.002755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:40.011718 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a790c9-5e99-4153-a699-10fdc4ae3a1c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:40.016361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:40.016983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:40.017269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:40.017546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:40.018362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=ec8970206985408597da37fc46a04f8c, user.id=c12b2db7e7354d5690eefc7bbb6f977d) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:40.018675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:40.020514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fd194-efbf-46a8-bc68-c94d274cb9b1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:40.026222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 584/1183] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:40 2022] GET /identity/v3/role_assignments?user.id=c12b2db7e7354d5690eefc7bbb6f977d&scope.project.id=ec8970206985408597da37fc46a04f8c&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:42.324754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18e9d-606e-4b81-a11f-8f156c22a6d6 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.325307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18e9d-606e-4b81-a11f-8f156c22a6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.325307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18e9d-606e-4b81-a11f-8f156c22a6d6 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.327067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 600/1184] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:42.332662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.333068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.333225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.352451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:42.353670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:42.361753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 585/1185] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:42.386346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18e9d-606e-4b81-a11f-8f156c22a6d6 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:42.399625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18e9d-606e-4b81-a11f-8f156c22a6d6 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:42.404079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:42.404856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.405144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.405428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.417003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:42.423743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:42.425024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 601/1186] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:42.431561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:42.440689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d329d-dbf6-4f85-92a4-0b5f52453799 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:42.445537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:42.446191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.446472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.446756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.447616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:42.447890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:42.449503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:42.458074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 586/1187] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:42.464661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:42.474701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4898bd-f15e-45bd-8c28-b6fd22375f84 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:42.479993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:42.480821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.481104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.481449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] PATH_INFO: `/v3/users/c12b2db7e7354d5690eefc7bbb6f977d` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.482622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=c12b2db7e7354d5690eefc7bbb6f977d)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:42.484771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:42.486322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 602/1188] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:42 2022] GET /identity/v3/users/c12b2db7e7354d5690eefc7bbb6f977d => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:42.492172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:42.501785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ef285-129c-4e71-ab1b-bd46913cb510 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:42.506409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15240571-77b6-4149-93f6-1e37d5742bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:42.507255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240571-77b6-4149-93f6-1e37d5742bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.507570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240571-77b6-4149-93f6-1e37d5742bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.507889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15240571-77b6-4149-93f6-1e37d5742bd8 admin admin] PATH_INFO: `/v3/projects/ec8970206985408597da37fc46a04f8c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.509086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15240571-77b6-4149-93f6-1e37d5742bd8 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec8970206985408597da37fc46a04f8c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:42.511100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15240571-77b6-4149-93f6-1e37d5742bd8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:42.512757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 587/1189] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:42 2022] GET /identity/v3/projects/ec8970206985408597da37fc46a04f8c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:51:42.518280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:42.528236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a1527-faa3-4646-9614-486af281d3a0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:42.532730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d638e6-0f7f-43c2-9361-4ca285e44b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:42.533564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d638e6-0f7f-43c2-9361-4ca285e44b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:42.533844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d638e6-0f7f-43c2-9361-4ca285e44b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:42.534119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d638e6-0f7f-43c2-9361-4ca285e44b42 admin admin] PATH_INFO: `/v3/projects/ec8970206985408597da37fc46a04f8c/users/c12b2db7e7354d5690eefc7bbb6f977d/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:42.536049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d638e6-0f7f-43c2-9361-4ca285e44b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8970206985408597da37fc46a04f8c, user_id=c12b2db7e7354d5690eefc7bbb6f977d, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:42.539261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d638e6-0f7f-43c2-9361-4ca285e44b42 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:42.611870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 603/1190] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:51:42 2022] PUT /identity/v3/projects/ec8970206985408597da37fc46a04f8c/users/c12b2db7e7354d5690eefc7bbb6f977d/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:51:44.931906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48721a0a-2fa7-433b-8694-3b7acc71f77b None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:44.932442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48721a0a-2fa7-433b-8694-3b7acc71f77b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:44.932442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48721a0a-2fa7-433b-8694-3b7acc71f77b None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:44.934233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 588/1191] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:51:44.939599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:44.940027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:44.940210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:44.959972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:51:44.961208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:51:45.017196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 604/1192] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:51:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:51:45.041906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48721a0a-2fa7-433b-8694-3b7acc71f77b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:45.054561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48721a0a-2fa7-433b-8694-3b7acc71f77b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:45.058941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:45.059704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:45.060014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:45.060287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:45.070218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:51:45.076816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:51:45.077961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 589/1193] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:51:45.084610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:45.093498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05856bf-5678-4068-8de5-d3f5e1d9ab06 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:45.098149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:45.098796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:45.099082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:45.099361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:45.100753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:45.100967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:45.102622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:45.110674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 605/1194] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:45.116857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:45.132210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca69e0-5f1b-4094-bea4-e99a26ca4800 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:45.136798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:45.137621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:45.137901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:45.138189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] PATH_INFO: `/v3/users/c12b2db7e7354d5690eefc7bbb6f977d` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:45.139352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] RBAC: Authorizing `identity:get_user(user_id=c12b2db7e7354d5690eefc7bbb6f977d)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:45.141480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:45.143100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 590/1195] 10.222.0.91 () {56 vars in 1198 bytes} [Mon Feb 21 00:51:45 2022] GET /identity/v3/users/c12b2db7e7354d5690eefc7bbb6f977d => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:45.149122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:45.158833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82675b8-da14-420a-b7b5-6fba45ab081d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:45.164574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:45.165205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:45.165494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:45.165774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:45.173546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:45.175289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:45.185459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 606/1196] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:51:45 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:51:45.190984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:45.200577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84f726-7399-434f-8508-efbc695fc472 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:45.205472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95020e-f653-4376-8b6a-f1e2be512f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:45.206295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95020e-f653-4376-8b6a-f1e2be512f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:45.206579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95020e-f653-4376-8b6a-f1e2be512f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:45.206851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95020e-f653-4376-8b6a-f1e2be512f7d admin admin] PATH_INFO: `/v3/projects/ec8970206985408597da37fc46a04f8c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:45.208049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95020e-f653-4376-8b6a-f1e2be512f7d admin admin] RBAC: Authorizing `identity:get_project(project_id=ec8970206985408597da37fc46a04f8c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:45.210126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95020e-f653-4376-8b6a-f1e2be512f7d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:45.211795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 591/1197] 10.222.0.91 () {56 vars in 1207 bytes} [Mon Feb 21 00:51:45 2022] GET /identity/v3/projects/ec8970206985408597da37fc46a04f8c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:51:45.217755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:51:45.227503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a07a-e2eb-45b8-b4e0-e594421e79aa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:51:45.232226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:51:45.232853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:51:45.233138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:51:45.233419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:51:45.234244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=ec8970206985408597da37fc46a04f8c, user.id=c12b2db7e7354d5690eefc7bbb6f977d) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:51:45.234557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:51:45.236428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50252ed-a9ff-49f6-8651-1583d8417a23 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:51:45.243379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 607/1198] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:51:45 2022] GET /identity/v3/role_assignments?user.id=c12b2db7e7354d5690eefc7bbb6f977d&scope.project.id=ec8970206985408597da37fc46a04f8c&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:10.207406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654271-c63c-486b-bef7-75600e381c44 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:10.208016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654271-c63c-486b-bef7-75600e381c44 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:10.208016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654271-c63c-486b-bef7-75600e381c44 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:10.209783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 592/1199] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:10.215018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:10.215447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:10.215562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:10.233130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:10.234327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:10.242497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 608/1200] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:10.267468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654271-c63c-486b-bef7-75600e381c44 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:10.280005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654271-c63c-486b-bef7-75600e381c44 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:10.284408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:10.286535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:10.286535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:10.286535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:10.296767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:10.298641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:10.315691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:10.316929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 593/1201] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:10.323348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:10.332949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e15995-26b2-4afd-a538-455884f7f81f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:10.338304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:10.338951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:10.339238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:10.339516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:10.340272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:10.340580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:10.342178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50237f-32bd-4d1a-9395-a60213ce106b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:10.354632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 609/1202] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:10.360371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:10.370773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8994fb-96e6-423a-8ee8-f0141d67517b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:10.375615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecec30-1495-4131-8fbc-7d2ec992e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:10.376301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecec30-1495-4131-8fbc-7d2ec992e659 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:10.376582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecec30-1495-4131-8fbc-7d2ec992e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:10.376860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecec30-1495-4131-8fbc-7d2ec992e659 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:10.377558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecec30-1495-4131-8fbc-7d2ec992e659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:10.379506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecec30-1495-4131-8fbc-7d2ec992e659 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:10.510289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 594/1203] 10.222.0.91 () {60 vars in 1153 bytes} [Mon Feb 21 00:53:10 2022] POST /identity/v3/users => generated 251 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:53:12.861552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abed04c-1233-418b-bdfa-bdefa05b7bcc None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:12.862111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abed04c-1233-418b-bdfa-bdefa05b7bcc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:12.862111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abed04c-1233-418b-bdfa-bdefa05b7bcc None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:12.863936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 610/1204] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:12.869268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:12.869713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:12.869836 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:12.888425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:12.890742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:12.897404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 595/1205] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:12.921680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abed04c-1233-418b-bdfa-bdefa05b7bcc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:12.936617 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abed04c-1233-418b-bdfa-bdefa05b7bcc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:12.941190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:12.941968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:12.942253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:12.942531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:12.954479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:53:12.961649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:53:12.962823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 611/1206] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:53:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:12.968777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:12.978073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42419a25-b08f-40a5-a45d-51266dbb42d0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:12.982647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:12.983291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:12.983575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:12.983896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:12.984667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:12.984973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:12.986545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:12.995232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 596/1207] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:53:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:13.001529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.011916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fd817-8529-4f5c-8a01-3a612efe8bde admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.016519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.017283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.017566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.017857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.027936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.029758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.046351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:13.055077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 612/1208] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:13.055213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.064148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a36ad-8c42-41bf-b044-9e776e95c210 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.068928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.069576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.070489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.071476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.072256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:13.072570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.074207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.086393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 597/1209] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:53:13.095164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.102042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc368-cfe4-4c0e-85ff-aa78c9f1763e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.106644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.107417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.107702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.108077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.115442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.118342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.132158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 00:53:13.139298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 613/1210] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:13.139908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.149536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ebe13-38d2-4cda-9218-4c26a349d8cb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.154145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.154811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.155091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.155364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.156220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:13.156524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.158323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.175666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 598/1211] 10.222.0.91 () {56 vars in 1164 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:13.182503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.192532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb75673-f167-4734-989c-3cd34bde9278 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.198202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.198834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.199120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.199718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.208049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.209783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.219303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 614/1212] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:53:13.225118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.234995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceba0-f5f4-4824-80bd-79cd361d289f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.239570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.240378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.240663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.240947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.251892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.253711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.271272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:13.272488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 599/1213] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:13.278469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.287344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000447f-1673-41a6-830d-c81980b2c5fa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.292589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.293222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.293502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.293777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.294488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:13.294789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.296488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.308244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 615/1214] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:13.313894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.324176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49157c70-44dc-45c5-8611-5c839cd0e86b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.329128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.330139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.330241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.330482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.337477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.339461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.352701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:53:13.353853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 600/1215] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:13.359957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.370497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602c37e-b50a-43e4-8dfe-899d154cbb69 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.374964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.375666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.375997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.376269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.377046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:13.377350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.379179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b9f7-ef02-42e5-a383-fa3b43351992 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.392466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 616/1216] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:13.398646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:13.409455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f7810-1f30-4d47-9972-931860758e99 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:13.415033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:13.425609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:13.425609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:13.425609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:13.425609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=6e9442e0d7974df3984122cad45a0320) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:13.425609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:13.426066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2352751-673a-4485-ba95-889e8741efe7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:13.426066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 601/1217] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:53:13 2022] GET /identity/v3/role_assignments?user.id=6e9442e0d7974df3984122cad45a0320&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:15.737595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75989164-8e14-47ed-853e-344c3ae61664 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.738455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75989164-8e14-47ed-853e-344c3ae61664 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.738455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75989164-8e14-47ed-853e-344c3ae61664 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.740487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 617/1218] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:15.747069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.747498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.747659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.764733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:15.765907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:15.773780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 602/1219] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:53:15.797099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75989164-8e14-47ed-853e-344c3ae61664 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:15.811667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75989164-8e14-47ed-853e-344c3ae61664 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:15.816108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:15.816869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.817150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.817424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.827695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:53:15.834448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:53:15.835628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 618/1220] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:15.842842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:15.855290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da6fe6-6aa3-4d09-9e41-652bd952f76b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:15.856750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:15.857400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.857684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.857965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.858748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:15.859056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:15.860682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:15.869375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 603/1221] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:53:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:15.874963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:15.885361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12694553-c510-4346-a9cc-c0cf3e01830a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:15.890054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:15.890805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.891167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.891455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.902434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:15.904331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:15.922088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:15.924040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 619/1222] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:15.929037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:15.938950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0def7-4390-453e-83c0-6d21e686a893 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:15.943470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:15.944139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.944422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.944736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.945449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:15.945748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:15.947304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:15.959042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 604/1223] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:15.965477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:15.975230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a012cf-54c3-4ba8-aaa1-12f160a30fdf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:15.980866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:15.981642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:15.981929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:15.982206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:15.989406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:15.991353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.005571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 00:53:16.006779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 620/1224] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:16.012896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:16.022539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c938f7-ad94-4946-af01-17f5619da3c7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:16.027668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:16.028455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:16.044312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:16.044312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:16.044312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:16.044312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:16.044312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.049548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 605/1225] 10.222.0.91 () {56 vars in 1164 bytes} [Mon Feb 21 00:53:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:53:16.055399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:16.065188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cbd8c-035a-4764-bf97-8cfb1f610b65 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:16.069992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:16.078711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:16.078711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:16.078711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:16.082059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:16.083936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.102306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:16.113100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 621/1226] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:16.113209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:16.119001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4d91e-139f-488e-ab1c-104916a1a933 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:16.123563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:16.124252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:16.124534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:16.124814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:16.125551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:16.125853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:16.127407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.138514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 606/1227] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:16.144068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:16.156917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b4c82-8471-4970-aa1c-2f1c8f4a07d1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:16.161700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:16.162564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:16.162849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:16.163167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:16.171086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:16.173062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.186196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:53:16.187351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 622/1228] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:16.193192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:16.203106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3d1ae-7412-4d27-9591-2237ca55901a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:16.207636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:16.208305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:16.208589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:16.208860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:16.209635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:16.209939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:16.212464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff5b2f-3d72-4d13-884a-b8419ac9f0d9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.224384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 607/1229] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:16.231256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:16.242567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d03bb5-a5c6-40f7-9022-8e486438a80b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:16.247114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dddf2-aeda-4d73-a621-284bba64e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:16.250638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dddf2-aeda-4d73-a621-284bba64e927 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:16.250638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dddf2-aeda-4d73-a621-284bba64e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:16.250638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dddf2-aeda-4d73-a621-284bba64e927 admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/6e9442e0d7974df3984122cad45a0320/roles/b97149e76fbf4c7c8e322e2acb9dc9f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:16.263362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dddf2-aeda-4d73-a621-284bba64e927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=6e9442e0d7974df3984122cad45a0320, role_id=b97149e76fbf4c7c8e322e2acb9dc9f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:16.266042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dddf2-aeda-4d73-a621-284bba64e927 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:16.364965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 623/1230] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:53:16 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/6e9442e0d7974df3984122cad45a0320/roles/b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:53:18.683499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c962e5-7177-46c4-9bf8-9cc792599a4e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.684035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c962e5-7177-46c4-9bf8-9cc792599a4e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.684035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c962e5-7177-46c4-9bf8-9cc792599a4e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.685782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 608/1231] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:18.691096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.691525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.691726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.711567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:18.715301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:18.770511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 624/1232] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:18.800789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c962e5-7177-46c4-9bf8-9cc792599a4e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:18.813524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c962e5-7177-46c4-9bf8-9cc792599a4e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:18.817881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:18.818646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.818928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.819204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.829387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:53:18.836140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 00:53:18.837444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 609/1233] 10.222.0.91 () {56 vars in 1123 bytes} [Mon Feb 21 00:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:53:18.843146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:18.852209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012bc7f-85d4-476d-ba49-683e7df3e731 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:18.857898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:18.858593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.858882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.859163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.860074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:18.860351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:18.861946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:18.871078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 625/1234] 10.222.0.91 () {56 vars in 1124 bytes} [Mon Feb 21 00:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:18.877099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:18.887666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b47de-ca38-41e7-b70d-a58a6b693352 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:18.892262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:18.893012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.893294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.893594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.904212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:18.906029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:18.924258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:18.925453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 610/1235] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:53:18.931600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:18.941563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7121e9-8c2f-481b-af7b-278dcfe8ee5c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:18.946098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:18.946763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.947045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.947323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.948087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:18.948396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:18.950229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:18.962654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 626/1236] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:18.968168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:18.978523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c8a31-39bf-48b6-a3ca-b80ae87aaca4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:18.982982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:18.983746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:18.984048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:18.984321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:18.991395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:18.993462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.008561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 00:53:19.009880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 611/1237] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:19.016197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.026631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a21b9e-1ab9-4b77-bc78-c31c496a8e3f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.031231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.031898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.032185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.032463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.033300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:19.033608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.035434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.053631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 627/1238] 10.222.0.91 () {56 vars in 1164 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:19.059692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.071524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55b6f3-a152-44f0-91ad-e64b4e223c7a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.078613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.085155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.085155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.085155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.088360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.090086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.098679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 612/1239] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:53:19.105232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.115219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46312889-d198-46b8-aa01-1335fdb2feb1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.120196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.120968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.121255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.121531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.131646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.133533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.151044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:19.152241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 628/1240] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:19.157881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.167294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c80d72-784b-47d0-9bb1-89e5a2eebeda admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.172007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.176486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.176486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.176486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.176486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:19.176486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.176486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.187003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 613/1241] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:19.192496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.202745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b23b4-142a-4307-a05f-3fb62d7c397f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.207324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.208119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.208409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.208690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.216306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.218390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.232065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:53:19.233194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 629/1242] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:19.238787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.248525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667928-4c3c-4f1a-99dd-79337400643e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.253122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.253757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.254040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.254317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.255094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:19.255403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.257251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd31665-a717-4da6-8dce-ca21b6eede16 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.387813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 614/1243] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:19.394032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:19.405226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e3992-d2cd-4102-82d5-831f5a2b2081 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:19.409802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:19.410426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:19.410708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:19.410984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:19.411949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] RBAC: Adding query filter params (role.id=b97149e76fbf4c7c8e322e2acb9dc9f6, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=6e9442e0d7974df3984122cad45a0320) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:19.412260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:19.414101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf509ef6-7acb-4608-bc78-cc032c795397 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:19.420621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 630/1244] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:53:19 2022] GET /identity/v3/role_assignments?user.id=6e9442e0d7974df3984122cad45a0320&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=b97149e76fbf4c7c8e322e2acb9dc9f6 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:21.779031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0b981-6378-4d37-a8fb-91b5ec622b2d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:21.779563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0b981-6378-4d37-a8fb-91b5ec622b2d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:21.779563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0b981-6378-4d37-a8fb-91b5ec622b2d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:21.781500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 615/1245] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:21.786790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:21.787230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:21.787335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:21.804845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:21.806147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:21.813802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 631/1246] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:21.838830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0b981-6378-4d37-a8fb-91b5ec622b2d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:21.852323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0b981-6378-4d37-a8fb-91b5ec622b2d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:21.857068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:21.857827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:21.858105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:21.858378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:21.869066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:53:21.875730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:53:21.876910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 616/1247] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:53:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:21.882941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:21.893624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835e26f-0859-4817-a960-bd23e6947bc5 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:21.898160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:21.898800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:21.899078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:21.901136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:21.901910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:21.902214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:21.903802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:21.912282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 632/1248] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:21.918201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:21.928408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc9e4e-32f3-4913-9ae0-a6b61f5d6a85 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:21.933971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:21.934864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:21.935010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:21.935284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:21.945303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:21.947775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:21.964546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:21.965706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 617/1249] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:21.971752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:21.982196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804071f2-6a7e-44fa-8e47-e48ae5ba59ba admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:21.986874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:21.987516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:21.987804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:21.988252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:21.989014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:21.989325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:21.990949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.004377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 633/1250] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:22.010975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.020854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952577d6-61cb-47b0-953b-40c348e97b32 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.025576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.026341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.026618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.026949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.034158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.036132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.049513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 00:53:22.050654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 618/1251] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:22.057348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.066902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79fa86-33db-49d6-b88f-219374d00d43 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.071501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.072932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.073212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.073481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.074575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:22.074882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.076725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.099590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 634/1252] 10.222.0.91 () {56 vars in 1164 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:22.105397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.115073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a06a03-8c52-4e74-b2fa-9870752718e2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.120206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.120825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.121106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.121396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.129050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.130754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.140617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 619/1253] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:53:22.146577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.156622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114d8b-3159-4f63-8052-19dadba99041 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.161281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.162043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.162321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.162596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.172610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.174427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.199727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:22.202064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 635/1254] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:22.208675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.218639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430688d-ce2e-49a2-816b-a391f96b56d8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.223168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.223877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.224161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.224446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.225135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:22.225434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.226983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.239168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 620/1255] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:22.245718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.255635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48baecf-dfa5-4e64-8f02-c51e0583ffab admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.261060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.261828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.262155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.262431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.269446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.271384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.284134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:53:22.285315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 636/1256] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:22.291774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.301408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c24a01-d7bd-4ae7-8d9f-7412f8335844 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.316669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.316669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.316669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.316669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.317033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:22.317033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.317033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2fe5c-8117-4820-8445-5ab7840241da admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.322533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 621/1257] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:22.328968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:22.340295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c38384-edf2-4512-8f6f-2ddfcc84270a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:22.344952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:22.345576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:22.345861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:22.346142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:22.347071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=6e9442e0d7974df3984122cad45a0320) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:22.347440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:22.349450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441fbbb-f01c-4c2f-a8d7-71184af65815 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:22.356219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 637/1258] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:53:22 2022] GET /identity/v3/role_assignments?user.id=6e9442e0d7974df3984122cad45a0320&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=30d31529b5824c178844aea14bad4358 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:24.630118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84081db5-5c63-4e6d-840c-8b8f99addbf5 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.630669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84081db5-5c63-4e6d-840c-8b8f99addbf5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.630669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84081db5-5c63-4e6d-840c-8b8f99addbf5 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.632391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 622/1259] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:24.638844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.639294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.639418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.658491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:24.659673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:24.667400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 638/1260] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:24.690644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84081db5-5c63-4e6d-840c-8b8f99addbf5 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.703590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84081db5-5c63-4e6d-840c-8b8f99addbf5 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.708052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.708819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.709106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.709383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.720625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:53:24.727334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:53:24.728613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 623/1261] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:24.734441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.743752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c1681-92aa-4ad5-b69e-9b35a023c4a1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.748800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.750148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.750148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.750148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.750715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:24.751030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:24.752661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:24.761675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 639/1262] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:24.767032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.777210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3ba87-c3f4-4a30-bce4-58ceef206b8e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.781764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.782517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.782801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.783079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.793036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:24.794847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:24.811199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:24.815508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 624/1263] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:24.818221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.829080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c09a-a5e5-46cc-9d21-cef88c4d0759 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.833586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.834224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.834506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.834781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.835501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:24.835805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:24.838093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:24.849988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 640/1264] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:24.856136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.865794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56555333-566a-4b3c-a13e-7f3ac0c41a94 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.870818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.871633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.871953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.872233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.879467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:24.881560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:24.895939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 00:53:24.897129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 625/1265] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:24.903011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.912723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a0a4a-9a5b-4016-97b1-bd569b87e97d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.918822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.918822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.918822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.918822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.919318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:24.919516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:24.921385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:24.939599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 641/1266] 10.222.0.91 () {56 vars in 1164 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:24.945485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:24.956538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd0ac7-f680-48f4-bc25-b45c7d6d8034 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:24.961129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:24.961894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:24.962194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:24.962590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:24.972900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:24.974713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:24.991696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:24.992944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 626/1267] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:24.999698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:25.010024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44da5-c828-4d7b-928b-4f9e4e42e97e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:25.014602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:25.015239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:25.015520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:25.015796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:25.016582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:25.016886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:25.018475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:25.029942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 642/1268] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:25.035469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:25.045253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7f54-8c16-4c08-b6d5-5221ce899347 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:25.049752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:25.050555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:25.050906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:25.051189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:25.058520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:25.060502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:25.074100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:53:25.078729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 627/1269] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:25.080957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:25.091081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd1010-518d-4d71-bd78-313a9c993f49 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:25.095645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:25.096373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:25.096658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:25.096937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:25.097725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:25.098037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:25.099943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59da05-2cbd-4b88-b82c-a7eb3ef55e24 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:25.113214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 643/1270] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 00:53:25.119812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:25.130078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0372dfe-c29e-4ad1-aaed-3a4deaa6b0c5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:25.135325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba7a53-7f92-40f5-9539-066aa86eabbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:25.136158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba7a53-7f92-40f5-9539-066aa86eabbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:25.136442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba7a53-7f92-40f5-9539-066aa86eabbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:25.136717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba7a53-7f92-40f5-9539-066aa86eabbf admin admin] PATH_INFO: `/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/6e9442e0d7974df3984122cad45a0320/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:25.138641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba7a53-7f92-40f5-9539-066aa86eabbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1f9f3926b4b1d94e6c597bf84917e, user_id=6e9442e0d7974df3984122cad45a0320, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:25.141289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba7a53-7f92-40f5-9539-066aa86eabbf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:25.279679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 628/1271] 10.222.0.91 () {58 vars in 1460 bytes} [Mon Feb 21 00:53:25 2022] PUT /identity/v3/projects/1af1f9f3926b4b1d94e6c597bf84917e/users/6e9442e0d7974df3984122cad45a0320/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 00:53:27.601174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b4bac-c4ca-45ca-809f-b99f12ee536d None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.601699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b4bac-c4ca-45ca-809f-b99f12ee536d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.601822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b4bac-c4ca-45ca-809f-b99f12ee536d None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.603550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 644/1272] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:27.609313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.609827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.609827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.628502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:27.637018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:27.685373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 629/1273] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 00:53:27.709662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b4bac-c4ca-45ca-809f-b99f12ee536d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.722958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b4bac-c4ca-45ca-809f-b99f12ee536d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.727356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.728155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.728489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.728849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.739605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 00:53:27.746923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 00:53:27.748159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 645/1274] 10.222.0.91 () {56 vars in 1117 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:27.754143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.763756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919873b-2041-4c5e-9f6c-53c62e67a320 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.768370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.769018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.769300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.769577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.770323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:27.770631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:27.772258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:27.781097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 630/1275] 10.222.0.91 () {56 vars in 1120 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:27.786782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.796840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec7199-ce58-4bb7-b59b-a97203750d00 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.801451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.802211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.802495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.802774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.813794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:27.815614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:27.833352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:27.834552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 646/1276] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:27.841222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.851046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca632374-2760-4001-8ce3-34f140f4473f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.856043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.856688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.856974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.857256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.857985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:27.858295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:27.859973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:27.873629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 631/1277] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:27.879294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.890023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d4a9a-7d26-4bba-9e8c-e661b2652dcb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.894732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.895505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.895871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.896157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.904522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:27.908011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:27.920351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 00:53:27.921500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 647/1278] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:27.927255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.938183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a250dd1-90a4-4e20-b240-df78a212610a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.942656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.943296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.943579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.943885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.944719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:27.945026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:27.946853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:27.964991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 632/1279] 10.222.0.91 () {56 vars in 1164 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:27.970928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:27.981375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9b20-3b8a-474e-b475-99ae499bfaf1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:27.985958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:27.986581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:27.986867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:27.987164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:27.995861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:27.999989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:28.006855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 648/1280] 10.222.0.91 () {58 vars in 1324 bytes} [Mon Feb 21 00:53:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 00:53:28.013588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:28.023322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509299b-2e46-4815-9e3d-40cb6b8ec955 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:28.027942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:28.028736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:28.034481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:28.034481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:28.039141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:28.040973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:28.057679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 00:53:28.058919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 633/1281] 10.222.0.91 () {56 vars in 1129 bytes} [Mon Feb 21 00:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 00:53:28.064591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:28.074808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9ef0b-f3f3-4903-a3ff-892d473df0bf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:28.079491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:28.080391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:28.080509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:28.080770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:28.081491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:28.081800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:28.083385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:28.099018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 649/1282] 10.222.0.91 () {56 vars in 1130 bytes} [Mon Feb 21 00:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:28.105013 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:28.114896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6970a05-12b7-4c8c-9b09-9d3e81ddb4f9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:28.120300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:28.121091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:28.121378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:28.121657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:28.128491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:28.130548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:28.144065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING keystone.server.flask.application [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 00:53:28.145208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 634/1283] 10.222.0.91 () {56 vars in 1132 bytes} [Mon Feb 21 00:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:28.150953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:28.160492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db790-547c-443b-a275-1d7376cafb5c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:28.164999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:28.165595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:28.165874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:28.166147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:28.166926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:28.167226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:28.169090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25cb3-4ae8-48de-a497-021f48a32604 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:28.180294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 650/1284] 10.222.0.91 () {56 vars in 1169 bytes} [Mon Feb 21 00:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:28.186823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:28.197427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22c089-50b2-4b74-a8d7-33d060a12d6d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:28.202894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:28.203620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:28.203945 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:28.204229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:28.208624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] RBAC: Adding query filter params (role.id=30d31529b5824c178844aea14bad4358, scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e, user.id=6e9442e0d7974df3984122cad45a0320) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:28.208624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:28.208624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f623e-133e-44e5-8087-e71abcb7b597 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:28.213110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 635/1285] 10.222.0.91 () {56 vars in 1395 bytes} [Mon Feb 21 00:53:28 2022] GET /identity/v3/role_assignments?user.id=6e9442e0d7974df3984122cad45a0320&scope.project.id=1af1f9f3926b4b1d94e6c597bf84917e&role.id=30d31529b5824c178844aea14bad4358 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:30.598834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e71c4-54a0-4cbe-a705-515d88ca3066 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:30.599388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e71c4-54a0-4cbe-a705-515d88ca3066 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:30.599388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e71c4-54a0-4cbe-a705-515d88ca3066 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:30.601204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 651/1286] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:30.607195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:30.607611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:30.607714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:30.625353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:30.626520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:30.634222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 636/1287] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:30.656523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e71c4-54a0-4cbe-a705-515d88ca3066 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:30.669618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e71c4-54a0-4cbe-a705-515d88ca3066 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:30.674084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:30.674856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:30.675142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:30.675421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:30.676114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:30.677704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:30.689642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 00:53:30.690804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 652/1288] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:53:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:30.696617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:30.706006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65eee-47c9-40e3-964b-b2157862d536 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:30.710466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:30.711107 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:30.711387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:30.711660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:30.712388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:30.712692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:30.714380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6223b5a-ec1c-454d-9257-267bc4708456 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:30.719179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 637/1289] 10.222.0.91 () {56 vars in 1137 bytes} [Mon Feb 21 00:53:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:30.724733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:30.735259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3fe1f-ae6d-4cf6-9ef5-80b38a85e573 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:30.739877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:30.740521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:30.740808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:30.741123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] PATH_INFO: `/v3/services` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:30.741930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:30.742238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:30.743818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319ab25-01a6-43e5-8f5e-84e500da0f6b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:30.749348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 653/1290] 10.222.0.91 () {56 vars in 1137 bytes} [Mon Feb 21 00:53:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:33.067007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98e97-f40f-40c3-bd2a-cd89eb20ccef None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:33.067879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98e97-f40f-40c3-bd2a-cd89eb20ccef None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:33.068064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba98e97-f40f-40c3-bd2a-cd89eb20ccef None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:33.069961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 638/1291] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:33.077890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a535e9-9785-4c14-b9d2-65b89934ddbc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:33.078541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a535e9-9785-4c14-b9d2-65b89934ddbc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:33.078676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a535e9-9785-4c14-b9d2-65b89934ddbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:33.097257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-25a535e9-9785-4c14-b9d2-65b89934ddbc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:33.098468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-25a535e9-9785-4c14-b9d2-65b89934ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:33.106406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 654/1292] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:33.129939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98e97-f40f-40c3-bd2a-cd89eb20ccef None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:33.143056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba98e97-f40f-40c3-bd2a-cd89eb20ccef None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:33.147445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467d6ff-8f28-462c-bbe9-388d50a6e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:33.148110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d6ff-8f28-462c-bbe9-388d50a6e852 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:33.148393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d6ff-8f28-462c-bbe9-388d50a6e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:33.148667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467d6ff-8f28-462c-bbe9-388d50a6e852 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:33.149387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467d6ff-8f28-462c-bbe9-388d50a6e852 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:33.150976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467d6ff-8f28-462c-bbe9-388d50a6e852 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:33.240488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 639/1293] 10.222.0.91 () {60 vars in 1162 bytes} [Mon Feb 21 00:53:33 2022] POST /identity/v3/services => generated 246 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 00:53:35.566496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aec2a1-dda5-40bb-aec8-c8a1d12ad9e9 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:35.567042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aec2a1-dda5-40bb-aec8-c8a1d12ad9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:35.567042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aec2a1-dda5-40bb-aec8-c8a1d12ad9e9 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:35.568895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 655/1294] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:35.574174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:35.576358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:35.576358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:35.593382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:35.594551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:35.612580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 640/1295] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:35 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:35.635629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aec2a1-dda5-40bb-aec8-c8a1d12ad9e9 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:35.648075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aec2a1-dda5-40bb-aec8-c8a1d12ad9e9 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:35.653194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:35.659223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:35.659223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:35.659223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:35.659223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:35.659223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:35.669412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 00:53:35.670640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 656/1296] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:53:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:35.676727 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:35.686149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320acd2-aef4-41ee-add2-fd2642086e61 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:35.691465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:35.692249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:35.694245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:35.694548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:35.695271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:35.695593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:35.697985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:35.703762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 641/1297] 10.222.0.91 () {56 vars in 1137 bytes} [Mon Feb 21 00:53:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:35.709702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:35.720040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2057ab8-08c3-4ebe-8d3b-39fff83efad4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:35.724640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:35.728017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:35.728017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:35.728017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:35.728017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] RBAC: Adding query filter params (interface=public, service_id=fdc950f9e3ab4ef68d4a7e2fc35567c0, region_id=RegionOne) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:35.728017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:35.728475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c07274-d610-4a19-b9fa-40aefa74cf6f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:35.733436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 657/1298] 10.222.0.91 () {56 vars in 1272 bytes} [Mon Feb 21 00:53:35 2022] GET /identity/v3/endpoints?service_id=fdc950f9e3ab4ef68d4a7e2fc35567c0&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:35.738818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:35.748274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68d36f-c24f-4236-a2c3-e4bc501b7036 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:35.752771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8b085-b697-4144-ae16-a98b1095e317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:35.753395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8b085-b697-4144-ae16-a98b1095e317 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:35.753676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8b085-b697-4144-ae16-a98b1095e317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:35.753949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8b085-b697-4144-ae16-a98b1095e317 admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:35.754610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8b085-b697-4144-ae16-a98b1095e317 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:35.756208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8b085-b697-4144-ae16-a98b1095e317 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:35.763314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 642/1299] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 00:53:35 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 00:53:38.040673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baf3d1-4e9b-4a14-bdb7-10db2b3e28fd None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:38.041716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baf3d1-4e9b-4a14-bdb7-10db2b3e28fd None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:38.041881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baf3d1-4e9b-4a14-bdb7-10db2b3e28fd None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:38.044028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 658/1300] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 00:53:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 00:53:38.052191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:38.052625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:38.052760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:38.072091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 00:53:38.073469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 00:53:38.081491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 643/1301] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 00:53:38 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 00:53:38.105918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baf3d1-4e9b-4a14-bdb7-10db2b3e28fd None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:38.118110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baf3d1-4e9b-4a14-bdb7-10db2b3e28fd None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:38.123311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:38.124220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:38.124448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:38.124720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:38.125373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:38.126947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:38.137955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 00:53:38.139097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 659/1302] 10.222.0.91 () {56 vars in 1138 bytes} [Mon Feb 21 00:53:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 00:53:38.145237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:38.154853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42a20f-b9a1-4a94-abcf-6e959900ea6d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:38.159492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:38.160175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:38.160462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:38.160741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] PATH_INFO: `/v3/services` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:38.161445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 00:53:38.161756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:38.163334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b149ee7-faeb-4db1-bfa2-403094748c0e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:38.169450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 644/1303] 10.222.0.91 () {56 vars in 1137 bytes} [Mon Feb 21 00:53:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 00:53:38.175079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 00:53:38.185909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a4571-6a0e-4e6a-bfaa-bdec86dbfc8d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 00:53:38.190497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a34082-ab60-4c8e-a0e1-89982d7b77cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 00:53:38.191121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34082-ab60-4c8e-a0e1-89982d7b77cd admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 00:53:38.191409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34082-ab60-4c8e-a0e1-89982d7b77cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 00:53:38.191684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a34082-ab60-4c8e-a0e1-89982d7b77cd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 00:53:38.192460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a34082-ab60-4c8e-a0e1-89982d7b77cd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 00:53:38.194036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a34082-ab60-4c8e-a0e1-89982d7b77cd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 00:53:38.316004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 660/1304] 10.222.0.91 () {60 vars in 1165 bytes} [Mon Feb 21 00:53:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:00:32.870056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebe6df-2db1-4879-b2b7-11fb0844fc8b None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:32.871484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebe6df-2db1-4879-b2b7-11fb0844fc8b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:32.872210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebe6df-2db1-4879-b2b7-11fb0844fc8b None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:32.876071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 645/1305] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:32.882591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ad30-8f38-4de6-983c-d79179dff7c2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:32.883048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ad30-8f38-4de6-983c-d79179dff7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:32.883291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ad30-8f38-4de6-983c-d79179dff7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:32.970929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-6b99ad30-8f38-4de6-983c-d79179dff7c2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:32.970929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6b99ad30-8f38-4de6-983c-d79179dff7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:33.105516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 661/1306] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:33.130931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebe6df-2db1-4879-b2b7-11fb0844fc8b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:33.133403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-10ebe6df-2db1-4879-b2b7-11fb0844fc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:33.309567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebe6df-2db1-4879-b2b7-11fb0844fc8b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:33.422016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9abd27-5f2c-49bd-b642-e0a0e29c8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:33.422806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9abd27-5f2c-49bd-b642-e0a0e29c8a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:33.423151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9abd27-5f2c-49bd-b642-e0a0e29c8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:33.423547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9abd27-5f2c-49bd-b642-e0a0e29c8a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:33.424423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9abd27-5f2c-49bd-b642-e0a0e29c8a03 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:33.426422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9abd27-5f2c-49bd-b642-e0a0e29c8a03 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:33.449758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 646/1307] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 01:00:33 2022] GET /identity/v3/projects => generated 2553 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:00:35.891856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dce87f-c225-4733-9e8c-9a131824be89 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:35.892469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dce87f-c225-4733-9e8c-9a131824be89 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:35.892823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dce87f-c225-4733-9e8c-9a131824be89 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:35.894803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 662/1308] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:00:35.900795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feba768-edd7-408c-86e9-e75a0ea98cfa None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:35.901331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feba768-edd7-408c-86e9-e75a0ea98cfa None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:35.901430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feba768-edd7-408c-86e9-e75a0ea98cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:36.015933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-0feba768-edd7-408c-86e9-e75a0ea98cfa None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:36.017258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0feba768-edd7-408c-86e9-e75a0ea98cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:36.143040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 647/1309] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:36.199040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea368e-4a13-4a88-9673-cab2dd364513 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:36.199805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea368e-4a13-4a88-9673-cab2dd364513 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:36.200512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea368e-4a13-4a88-9673-cab2dd364513 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:36.202331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 663/1310] 10.222.0.91 () {54 vars in 964 bytes} [Mon Feb 21 01:00:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:36.209042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604f957-5ab8-48e7-8065-9c39aa009f8d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:36.209400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604f957-5ab8-48e7-8065-9c39aa009f8d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:36.209754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604f957-5ab8-48e7-8065-9c39aa009f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:36.295292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8604f957-5ab8-48e7-8065-9c39aa009f8d None None] MFA Rules not processed for user `84fdc361782f47a2976d393a6b5e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:36.296568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8604f957-5ab8-48e7-8065-9c39aa009f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:36.385136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 648/1311] 10.222.0.91 () {58 vars in 1061 bytes} [Mon Feb 21 01:00:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:36.395093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea368e-4a13-4a88-9673-cab2dd364513 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:36.396784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8bea368e-4a13-4a88-9673-cab2dd364513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:36.527986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea368e-4a13-4a88-9673-cab2dd364513 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:36.610265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:36.611007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:36.611296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:36.611573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:36.613294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:36.734267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:36.736130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39caf98c-0a9c-460d-8b61-a0ccce4d1c73 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:36.756394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 664/1312] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:00:39.400455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1530c-1302-46d4-aa89-0baff94dae1f None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:39.401022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1530c-1302-46d4-aa89-0baff94dae1f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:39.401022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1530c-1302-46d4-aa89-0baff94dae1f None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:39.403970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 649/1313] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:39.409574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db3d7-a180-46e8-8540-a3031948c5c2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:39.410059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db3d7-a180-46e8-8540-a3031948c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:39.410387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069db3d7-a180-46e8-8540-a3031948c5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:39.485279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-069db3d7-a180-46e8-8540-a3031948c5c2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:39.486479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-069db3d7-a180-46e8-8540-a3031948c5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:39.580478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 665/1314] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:39.618916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1530c-1302-46d4-aa89-0baff94dae1f None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:39.623532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dce1530c-1302-46d4-aa89-0baff94dae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:39.724496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1530c-1302-46d4-aa89-0baff94dae1f None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:39.795463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:39.796136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:39.796422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:39.796700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:39.798351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:39.906034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:39.907395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfa7e5-1724-427b-9cc0-b47782a70a8f service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:39.925473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 650/1315] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:00:42.779054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53a6b-b7c2-4469-aa7c-16cae30a9722 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:42.782494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53a6b-b7c2-4469-aa7c-16cae30a9722 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:42.782494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc53a6b-b7c2-4469-aa7c-16cae30a9722 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:42.782494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 666/1316] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:42.787074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800285c4-aee4-436c-a66a-6ad55ab218a6 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:42.787522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800285c4-aee4-436c-a66a-6ad55ab218a6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:42.787717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800285c4-aee4-436c-a66a-6ad55ab218a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:42.855951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-800285c4-aee4-436c-a66a-6ad55ab218a6 None None] MFA Rules not processed for user `e6052ebd33784dfbbbd7dacf4169cb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:42.857459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-800285c4-aee4-436c-a66a-6ad55ab218a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:42.953147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 651/1317] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:42.993113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53a6b-b7c2-4469-aa7c-16cae30a9722 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:42.994710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6cc53a6b-b7c2-4469-aa7c-16cae30a9722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:43.097518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc53a6b-b7c2-4469-aa7c-16cae30a9722 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:43.170428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:43.171069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:43.171354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:43.171629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:43.173335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:43.288950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:43.290386 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accf28c-3886-43cf-a3eb-10369c76903f service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:43.309497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 667/1318] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:00:46.425314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3232-f60f-4b31-9c24-6e0a26a604ea None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:46.425867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3232-f60f-4b31-9c24-6e0a26a604ea None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:46.425867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3232-f60f-4b31-9c24-6e0a26a604ea None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:46.427658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 652/1319] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:46.433862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68cb0-789c-436e-91c9-4090032226ab None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:46.434289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68cb0-789c-436e-91c9-4090032226ab None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:46.434430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca68cb0-789c-436e-91c9-4090032226ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:46.498311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-eca68cb0-789c-436e-91c9-4090032226ab None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:46.499518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-eca68cb0-789c-436e-91c9-4090032226ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:46.606712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 668/1320] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:00:46.648547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca3232-f60f-4b31-9c24-6e0a26a604ea None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:46.650089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fdca3232-f60f-4b31-9c24-6e0a26a604ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:46.756032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca3232-f60f-4b31-9c24-6e0a26a604ea None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:46.835339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:46.836096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:46.836412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:46.836625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:46.838313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:46.950973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:46.952386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509f5e3-9b48-449e-a253-074a04c89f67 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:46.971881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 653/1321] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:00:50.391352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe348d-958b-4986-a39c-89b22bbf3e7f None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:50.391979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe348d-958b-4986-a39c-89b22bbf3e7f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:50.391979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe348d-958b-4986-a39c-89b22bbf3e7f None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:50.393872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 669/1322] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:50.399114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832e497-8a84-4a8c-8b29-7e43ebb09d81 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:50.399542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832e497-8a84-4a8c-8b29-7e43ebb09d81 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:50.399693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832e497-8a84-4a8c-8b29-7e43ebb09d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:50.466913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a832e497-8a84-4a8c-8b29-7e43ebb09d81 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:50.468132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a832e497-8a84-4a8c-8b29-7e43ebb09d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:50.565212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 654/1323] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:50.618328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadb50-a01e-4af4-b1f3-528693f41a43 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:50.618574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadb50-a01e-4af4-b1f3-528693f41a43 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:50.618807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadb50-a01e-4af4-b1f3-528693f41a43 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:50.622159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 670/1324] 10.222.0.91 () {54 vars in 964 bytes} [Mon Feb 21 01:00:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:50.628547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2d9dc-9c93-4698-9f42-9f64b6068d2a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:50.628805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2d9dc-9c93-4698-9f42-9f64b6068d2a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:50.629086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2d9dc-9c93-4698-9f42-9f64b6068d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:50.709166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-07c2d9dc-9c93-4698-9f42-9f64b6068d2a None None] MFA Rules not processed for user `84fdc361782f47a2976d393a6b5e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:50.710350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-07c2d9dc-9c93-4698-9f42-9f64b6068d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:50.789528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 655/1325] 10.222.0.91 () {58 vars in 1061 bytes} [Mon Feb 21 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:50.798560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadb50-a01e-4af4-b1f3-528693f41a43 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:50.800255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d7dadb50-a01e-4af4-b1f3-528693f41a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:50.922499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadb50-a01e-4af4-b1f3-528693f41a43 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:51.009619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:51.010342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:51.010551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:51.011370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:51.013119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:51.126869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:51.128342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d16ea-c844-48ce-ac09-f8664ee1275c service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:51.146582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 671/1326] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:00:53.800592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa49b-51cd-4abd-a083-34743d9ac34b None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:53.801274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa49b-51cd-4abd-a083-34743d9ac34b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:53.801274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835aa49b-51cd-4abd-a083-34743d9ac34b None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:53.802918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 656/1327] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:53.808597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee02a1-c98f-41d8-856f-943546a36cf7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:53.809903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee02a1-c98f-41d8-856f-943546a36cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:53.816519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee02a1-c98f-41d8-856f-943546a36cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:53.880569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b5ee02a1-c98f-41d8-856f-943546a36cf7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:53.882059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b5ee02a1-c98f-41d8-856f-943546a36cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:53.982404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 672/1328] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:54.020944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa49b-51cd-4abd-a083-34743d9ac34b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:54.022558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-835aa49b-51cd-4abd-a083-34743d9ac34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:54.137692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835aa49b-51cd-4abd-a083-34743d9ac34b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:54.215540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:54.216230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:54.216511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:54.216788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:54.218554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:54.349056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:54.350570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d0a33-fda9-4563-a407-a8cbdb28fcc4 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:54.374761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 657/1329] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:00:56.832840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a75549-1f26-49c4-a87f-19a3fa77ceaf None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:56.833405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a75549-1f26-49c4-a87f-19a3fa77ceaf None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:56.833405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a75549-1f26-49c4-a87f-19a3fa77ceaf None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:56.835166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 673/1330] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:00:56.840542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b305e61-827b-4cfb-9105-62917ae50ad4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:56.840948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b305e61-827b-4cfb-9105-62917ae50ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:56.841096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b305e61-827b-4cfb-9105-62917ae50ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:56.904536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1b305e61-827b-4cfb-9105-62917ae50ad4 None None] MFA Rules not processed for user `e6052ebd33784dfbbbd7dacf4169cb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:00:56.905649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1b305e61-827b-4cfb-9105-62917ae50ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:56.999794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 658/1331] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:00:57.037836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a75549-1f26-49c4-a87f-19a3fa77ceaf None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:00:57.039384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f9a75549-1f26-49c4-a87f-19a3fa77ceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:57.144088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a75549-1f26-49c4-a87f-19a3fa77ceaf None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:00:57.216565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:00:57.217221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:00:57.217507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:00:57.217788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:00:57.219444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:00:57.328680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:00:57.330399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59208c9-ad3f-4b68-8f4e-ed09386b07e1 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:00:57.349523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 674/1332] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:00.144056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986ed37-bb99-45cc-a11d-11deee0595dd None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:00.144574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986ed37-bb99-45cc-a11d-11deee0595dd None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:00.144574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986ed37-bb99-45cc-a11d-11deee0595dd None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:00.146425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 659/1333] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:00.151824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcab0c-bbf9-446b-a4f1-6277d051daf5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:00.152319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcab0c-bbf9-446b-a4f1-6277d051daf5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:00.152547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcab0c-bbf9-446b-a4f1-6277d051daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:00.216815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9bfcab0c-bbf9-446b-a4f1-6277d051daf5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:00.217960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9bfcab0c-bbf9-446b-a4f1-6277d051daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:00.314562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 675/1334] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:00.350793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986ed37-bb99-45cc-a11d-11deee0595dd None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:00.352410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e986ed37-bb99-45cc-a11d-11deee0595dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:00.463345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986ed37-bb99-45cc-a11d-11deee0595dd None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:00.537545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:00.538195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:00.538482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:00.538758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:00.540446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:00.655366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:00.656966 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92fb11-2fd3-4fdf-8f79-779884046501 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:00.677099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 660/1335] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:03.035165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6bd5-0fa0-49b1-9266-73e0bd74b689 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:03.035727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6bd5-0fa0-49b1-9266-73e0bd74b689 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:03.035727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6bd5-0fa0-49b1-9266-73e0bd74b689 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:03.037554 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 676/1336] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:03.043124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ea90-edb8-41ba-9b72-6c6430b791cc None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:03.043510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ea90-edb8-41ba-9b72-6c6430b791cc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:03.043679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ea90-edb8-41ba-9b72-6c6430b791cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:03.106112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-9e83ea90-edb8-41ba-9b72-6c6430b791cc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:03.107372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9e83ea90-edb8-41ba-9b72-6c6430b791cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:03.208455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 661/1337] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:03.249463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6bd5-0fa0-49b1-9266-73e0bd74b689 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:03.251695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-806d6bd5-0fa0-49b1-9266-73e0bd74b689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:03.359689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6bd5-0fa0-49b1-9266-73e0bd74b689 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:03.363546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf6875-021e-4cbf-a92d-58213399a755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:03.364219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf6875-021e-4cbf-a92d-58213399a755 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:03.364506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf6875-021e-4cbf-a92d-58213399a755 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:03.364783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf6875-021e-4cbf-a92d-58213399a755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:03.453616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf6875-021e-4cbf-a92d-58213399a755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:03.455081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf6875-021e-4cbf-a92d-58213399a755 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:03.473981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 677/1338] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:06.441027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad271-b2c7-462b-8500-bcbeb1878f67 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:06.441632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad271-b2c7-462b-8500-bcbeb1878f67 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:06.441632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad271-b2c7-462b-8500-bcbeb1878f67 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:06.443346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 662/1339] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:06.448630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1627-a050-48db-ad18-c29416f3c318 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:06.448630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1627-a050-48db-ad18-c29416f3c318 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:06.448630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c1627-a050-48db-ad18-c29416f3c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:06.506169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-447c1627-a050-48db-ad18-c29416f3c318 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:06.507353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-447c1627-a050-48db-ad18-c29416f3c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:06.582448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 678/1340] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:06.619046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad271-b2c7-462b-8500-bcbeb1878f67 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:06.623466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ddaad271-b2c7-462b-8500-bcbeb1878f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:06.634348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad271-b2c7-462b-8500-bcbeb1878f67 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:06.638838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f57d74-9d6b-44c4-a6f7-582ac8fd6ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:06.639475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57d74-9d6b-44c4-a6f7-582ac8fd6ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:06.639762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57d74-9d6b-44c4-a6f7-582ac8fd6ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:06.640080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f57d74-9d6b-44c4-a6f7-582ac8fd6ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:06.649418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57d74-9d6b-44c4-a6f7-582ac8fd6ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:06.651864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f57d74-9d6b-44c4-a6f7-582ac8fd6ba6 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:06.661354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 663/1341] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:11.543565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304105-9fd8-4d6f-97c1-6c8730555b9c None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:11.544139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304105-9fd8-4d6f-97c1-6c8730555b9c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:11.544139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304105-9fd8-4d6f-97c1-6c8730555b9c None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:11.545948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 679/1342] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:11.551276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2926-c948-4ca4-b70d-1dbfcff7c3ea None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:11.551720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2926-c948-4ca4-b70d-1dbfcff7c3ea None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:11.551821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b2926-c948-4ca4-b70d-1dbfcff7c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:11.581353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3b8b2926-c948-4ca4-b70d-1dbfcff7c3ea None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:11.582551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3b8b2926-c948-4ca4-b70d-1dbfcff7c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:11.590662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 664/1343] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:11.629814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304105-9fd8-4d6f-97c1-6c8730555b9c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:11.641133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304105-9fd8-4d6f-97c1-6c8730555b9c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:11.644626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9eeee6-ecb4-4b45-ace7-715f2b9c198c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:11.645285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eeee6-ecb4-4b45-ace7-715f2b9c198c service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:11.645573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eeee6-ecb4-4b45-ace7-715f2b9c198c service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:11.645851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eeee6-ecb4-4b45-ace7-715f2b9c198c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:11.655374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eeee6-ecb4-4b45-ace7-715f2b9c198c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:11.656842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9eeee6-ecb4-4b45-ace7-715f2b9c198c service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:11.666630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 680/1344] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:15.014751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62cfc6-f838-46f4-92bc-51b138ac317e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:15.015343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62cfc6-f838-46f4-92bc-51b138ac317e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:15.015343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62cfc6-f838-46f4-92bc-51b138ac317e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:15.017214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 665/1345] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:15.023502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef959-7078-4a14-8b0e-72f9c34fc792 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:15.024026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef959-7078-4a14-8b0e-72f9c34fc792 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:15.024142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef959-7078-4a14-8b0e-72f9c34fc792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:15.046209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-87eef959-7078-4a14-8b0e-72f9c34fc792 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:15.047407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-87eef959-7078-4a14-8b0e-72f9c34fc792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:15.055856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 681/1346] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:15.097320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62cfc6-f838-46f4-92bc-51b138ac317e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:15.108871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62cfc6-f838-46f4-92bc-51b138ac317e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:15.113548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63c28d-f013-4531-a224-6d7c0030c6bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:15.113548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c28d-f013-4531-a224-6d7c0030c6bd service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:15.113548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c28d-f013-4531-a224-6d7c0030c6bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:15.113878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c28d-f013-4531-a224-6d7c0030c6bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:15.124382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63c28d-f013-4531-a224-6d7c0030c6bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:15.125940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63c28d-f013-4531-a224-6d7c0030c6bd service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:15.137384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 666/1347] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:20.058308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16304-8689-49fc-b6fd-563f88518e14 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:20.058878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16304-8689-49fc-b6fd-563f88518e14 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:20.058878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e16304-8689-49fc-b6fd-563f88518e14 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:20.060973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 682/1348] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:20.066241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6b160-d14b-439d-ad1b-cc6963365645 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:20.066682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6b160-d14b-439d-ad1b-cc6963365645 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:20.066823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6b160-d14b-439d-ad1b-cc6963365645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:20.085385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a9f6b160-d14b-439d-ad1b-cc6963365645 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:20.086556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a9f6b160-d14b-439d-ad1b-cc6963365645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:20.095553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 667/1349] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:20.133573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16304-8689-49fc-b6fd-563f88518e14 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:20.144827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e16304-8689-49fc-b6fd-563f88518e14 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:20.148345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888627c-841c-4c44-8862-4a5eee1babec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:20.148985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888627c-841c-4c44-8862-4a5eee1babec service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:20.149266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888627c-841c-4c44-8862-4a5eee1babec service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:20.149541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888627c-841c-4c44-8862-4a5eee1babec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:20.159615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888627c-841c-4c44-8862-4a5eee1babec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:20.161103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888627c-841c-4c44-8862-4a5eee1babec service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:20.171799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 683/1350] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:25.437341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baea42-b655-4d31-9c99-169a6fce2a34 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:25.437341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baea42-b655-4d31-9c99-169a6fce2a34 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:25.437804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baea42-b655-4d31-9c99-169a6fce2a34 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:25.439465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 668/1351] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:25.444754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcedeb-4311-4c37-8dca-24949c885455 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:25.445519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcedeb-4311-4c37-8dca-24949c885455 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:25.445972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcedeb-4311-4c37-8dca-24949c885455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:25.555407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d1dcedeb-4311-4c37-8dca-24949c885455 None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:25.557267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d1dcedeb-4311-4c37-8dca-24949c885455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:25.658864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 684/1352] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:01:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:30.203944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a891-6916-4d66-83cb-44c2e4d43e14 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:30.204473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a891-6916-4d66-83cb-44c2e4d43e14 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:30.204585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a891-6916-4d66-83cb-44c2e4d43e14 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:30.206461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 669/1353] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:30.211491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62250-1cf7-4c3d-a131-3d428eaa0254 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:30.212546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62250-1cf7-4c3d-a131-3d428eaa0254 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:30.213036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e62250-1cf7-4c3d-a131-3d428eaa0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:30.232636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-78e62250-1cf7-4c3d-a131-3d428eaa0254 None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:30.234047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-78e62250-1cf7-4c3d-a131-3d428eaa0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:30.243105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 685/1354] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:31.544185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f287f2-ecfe-41d3-bdc3-75eb24da5ed6 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:31.544713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f287f2-ecfe-41d3-bdc3-75eb24da5ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:31.544796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f287f2-ecfe-41d3-bdc3-75eb24da5ed6 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:31.546678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 670/1355] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:31.640536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7cf47-dc50-417a-9f11-bd6c164fa21d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:31.641062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7cf47-dc50-417a-9f11-bd6c164fa21d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:31.641062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7cf47-dc50-417a-9f11-bd6c164fa21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:31.659358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-acc7cf47-dc50-417a-9f11-bd6c164fa21d None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:31.660576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-acc7cf47-dc50-417a-9f11-bd6c164fa21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:31.669181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 686/1356] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:35.682434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f162e6-a021-4734-af7c-6d71792d4e47 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:35.683008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f162e6-a021-4734-af7c-6d71792d4e47 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:35.683008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f162e6-a021-4734-af7c-6d71792d4e47 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:35.685127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 671/1357] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:35.690162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761846d-2b54-4fc1-83d7-1d28c664e1df None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:35.690584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761846d-2b54-4fc1-83d7-1d28c664e1df None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:35.690733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761846d-2b54-4fc1-83d7-1d28c664e1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:35.709140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b761846d-2b54-4fc1-83d7-1d28c664e1df None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:35.710549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b761846d-2b54-4fc1-83d7-1d28c664e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:35.719480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 687/1358] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:35.768299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b9d3f-c169-4693-92de-c9f1e762a980 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:35.768589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b9d3f-c169-4693-92de-c9f1e762a980 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:35.769068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b9d3f-c169-4693-92de-c9f1e762a980 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:35.770990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 672/1359] 10.222.0.91 () {54 vars in 961 bytes} [Mon Feb 21 01:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:35.777585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9cc98-ee4d-474a-905c-5d39a7a47491 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:35.778037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9cc98-ee4d-474a-905c-5d39a7a47491 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:35.778417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9cc98-ee4d-474a-905c-5d39a7a47491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:35.846236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-03d9cc98-ee4d-474a-905c-5d39a7a47491 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:35.847715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-03d9cc98-ee4d-474a-905c-5d39a7a47491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:35.940105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 688/1360] 10.222.0.91 () {58 vars in 1058 bytes} [Mon Feb 21 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:35.949777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b9d3f-c169-4693-92de-c9f1e762a980 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:35.967091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b9d3f-c169-4693-92de-c9f1e762a980 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:35.973524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a15fb9-3cac-4d4a-bbe5-29bce40acde7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:35.974167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a15fb9-3cac-4d4a-bbe5-29bce40acde7 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:35.974454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a15fb9-3cac-4d4a-bbe5-29bce40acde7 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:35.974732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a15fb9-3cac-4d4a-bbe5-29bce40acde7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:35.984678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a15fb9-3cac-4d4a-bbe5-29bce40acde7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:35.986261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a15fb9-3cac-4d4a-bbe5-29bce40acde7 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:35.997038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 673/1361] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:38.584318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24610e28-1f61-4245-aae2-66f67b5bf37f None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:38.584828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24610e28-1f61-4245-aae2-66f67b5bf37f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:38.584828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24610e28-1f61-4245-aae2-66f67b5bf37f None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:38.587338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 689/1362] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:38.592442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c13863-994a-4acc-9142-cd37a1a0a62d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:38.592897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c13863-994a-4acc-9142-cd37a1a0a62d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:38.592991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c13863-994a-4acc-9142-cd37a1a0a62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:38.611148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d0c13863-994a-4acc-9142-cd37a1a0a62d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:38.612380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d0c13863-994a-4acc-9142-cd37a1a0a62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:38.621094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 674/1363] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:38.666059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24610e28-1f61-4245-aae2-66f67b5bf37f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:38.683573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24610e28-1f61-4245-aae2-66f67b5bf37f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:38.688552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29ed96-18c8-45c4-85de-6a3fb79656ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:38.689151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29ed96-18c8-45c4-85de-6a3fb79656ae service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:38.694049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29ed96-18c8-45c4-85de-6a3fb79656ae service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:38.694972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29ed96-18c8-45c4-85de-6a3fb79656ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:38.704985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29ed96-18c8-45c4-85de-6a3fb79656ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:38.706811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29ed96-18c8-45c4-85de-6a3fb79656ae service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:38.717059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 690/1364] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:41.513095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410734-086f-43b0-9a08-ebcc4f78f9f3 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:41.513605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410734-086f-43b0-9a08-ebcc4f78f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:41.513686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2410734-086f-43b0-9a08-ebcc4f78f9f3 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:41.515540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 675/1365] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:41.521346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa3bad-716a-4bd2-b9cb-41fca2ace5dc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:41.521878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa3bad-716a-4bd2-b9cb-41fca2ace5dc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:41.522262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa3bad-716a-4bd2-b9cb-41fca2ace5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:41.542824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-24fa3bad-716a-4bd2-b9cb-41fca2ace5dc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:41.544048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-24fa3bad-716a-4bd2-b9cb-41fca2ace5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:41.552448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 691/1366] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:41.598969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a43e88-0d35-46d7-85aa-713337b2c0b0 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:41.599415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a43e88-0d35-46d7-85aa-713337b2c0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:41.599797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a43e88-0d35-46d7-85aa-713337b2c0b0 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:41.602144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 676/1367] 10.222.0.91 () {54 vars in 961 bytes} [Mon Feb 21 01:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:41.607907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e46823-864e-45bd-85e3-9419e9fd43de None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:41.608400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e46823-864e-45bd-85e3-9419e9fd43de None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:41.608847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e46823-864e-45bd-85e3-9419e9fd43de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:41.629878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d2e46823-864e-45bd-85e3-9419e9fd43de None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:41.631296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d2e46823-864e-45bd-85e3-9419e9fd43de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:41.641576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 692/1368] 10.222.0.91 () {58 vars in 1058 bytes} [Mon Feb 21 01:01:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:41.649601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a43e88-0d35-46d7-85aa-713337b2c0b0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:41.665888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a43e88-0d35-46d7-85aa-713337b2c0b0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:41.674647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe9035-c419-4a78-879e-8de83cc0a85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:41.675313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe9035-c419-4a78-879e-8de83cc0a85f service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:41.675944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe9035-c419-4a78-879e-8de83cc0a85f service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:41.676369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe9035-c419-4a78-879e-8de83cc0a85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:41.690837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe9035-c419-4a78-879e-8de83cc0a85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:41.693403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe9035-c419-4a78-879e-8de83cc0a85f service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:41.706477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 677/1369] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:43.969036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a81ae-7383-45d1-88bb-37115ecf6d5c None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:43.969614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a81ae-7383-45d1-88bb-37115ecf6d5c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:43.969614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a81ae-7383-45d1-88bb-37115ecf6d5c None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:43.971356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 693/1370] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:43.977659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53220f3-a115-4929-aab2-ee1cf1bdcf2f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:43.978167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53220f3-a115-4929-aab2-ee1cf1bdcf2f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:43.978369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53220f3-a115-4929-aab2-ee1cf1bdcf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.004992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d53220f3-a115-4929-aab2-ee1cf1bdcf2f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:44.006387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d53220f3-a115-4929-aab2-ee1cf1bdcf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:44.024195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 678/1371] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:44.285509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f973c2-82aa-4621-8245-e007d5ad00c7 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:44.286076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f973c2-82aa-4621-8245-e007d5ad00c7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:44.286561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f973c2-82aa-4621-8245-e007d5ad00c7 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.289914 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 694/1372] 10.222.0.91 () {54 vars in 963 bytes} [Mon Feb 21 01:01:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:44.295550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:44.296147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:44.296633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.366706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] MFA Rules not processed for user `7c90c0c26a544e089b126df43151e6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:44.368411 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:44.382041 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd717cb-c124-48bd-b267-9d124b26a9f6 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:44.382420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd717cb-c124-48bd-b267-9d124b26a9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:44.382773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd717cb-c124-48bd-b267-9d124b26a9f6 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.384781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 695/1373] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:44.390403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:44.390695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:44.391130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.413566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:44.415652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:44.424524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 696/1374] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:01:44.450927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 679/1375] 10.222.0.91 () {58 vars in 1060 bytes} [Mon Feb 21 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:44.459980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:44.470202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aefe3e-9040-4605-948e-a3b8bed543cf None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:44.470822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:44.474751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7c0e4-4e85-46f3-a38c-d01a97b8cb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:44.475723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7c0e4-4e85-46f3-a38c-d01a97b8cb9e service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:44.475723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7c0e4-4e85-46f3-a38c-d01a97b8cb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:44.476045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7c0e4-4e85-46f3-a38c-d01a97b8cb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.485408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d19e7c-4262-4790-8f51-9c09cd381b3a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:44.487251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7c0e4-4e85-46f3-a38c-d01a97b8cb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:44.488755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7c0e4-4e85-46f3-a38c-d01a97b8cb9e service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:44.490951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106399dc-cd88-440b-857d-fef8e28b7c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:44.491601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106399dc-cd88-440b-857d-fef8e28b7c06 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:44.492026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106399dc-cd88-440b-857d-fef8e28b7c06 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:44.492359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106399dc-cd88-440b-857d-fef8e28b7c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:44.498954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 697/1376] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:44.503925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106399dc-cd88-440b-857d-fef8e28b7c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:44.505538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106399dc-cd88-440b-857d-fef8e28b7c06 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:44.518530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 680/1377] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:01:47.080416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514541a8-affd-4ad5-9590-e31b69390644 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:47.081139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514541a8-affd-4ad5-9590-e31b69390644 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:47.081139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514541a8-affd-4ad5-9590-e31b69390644 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:47.082831 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 698/1378] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:47.089351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedfea-c5fd-48d2-83a7-a68ed6845146 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:47.089786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedfea-c5fd-48d2-83a7-a68ed6845146 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:47.089905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbedfea-c5fd-48d2-83a7-a68ed6845146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:47.107906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-0fbedfea-c5fd-48d2-83a7-a68ed6845146 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:47.109100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0fbedfea-c5fd-48d2-83a7-a68ed6845146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:47.117063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 681/1379] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:47.165820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514541a8-affd-4ad5-9590-e31b69390644 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:47.181546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514541a8-affd-4ad5-9590-e31b69390644 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:47.188213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6952f-d97d-4ef5-b7d4-e4ef96311a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:47.189729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6952f-d97d-4ef5-b7d4-e4ef96311a36 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:47.189729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6952f-d97d-4ef5-b7d4-e4ef96311a36 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:47.189729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6952f-d97d-4ef5-b7d4-e4ef96311a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:47.198595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6952f-d97d-4ef5-b7d4-e4ef96311a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:47.200242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6952f-d97d-4ef5-b7d4-e4ef96311a36 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:47.212613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 699/1380] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:49.755907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5ef2-a980-49ed-8ea0-86bf75884e25 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:49.756859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5ef2-a980-49ed-8ea0-86bf75884e25 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:49.757298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da5ef2-a980-49ed-8ea0-86bf75884e25 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:49.759952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 682/1381] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:49.765523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700940-7b52-4209-9d87-0ec56bd11821 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:49.766009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700940-7b52-4209-9d87-0ec56bd11821 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:49.766090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a700940-7b52-4209-9d87-0ec56bd11821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:49.786290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3a700940-7b52-4209-9d87-0ec56bd11821 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:49.787483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3a700940-7b52-4209-9d87-0ec56bd11821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:49.797279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 700/1382] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:49.846243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da5ef2-a980-49ed-8ea0-86bf75884e25 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:49.863023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da5ef2-a980-49ed-8ea0-86bf75884e25 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:49.869621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08c802-70c5-4db2-849a-53b08e21285c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:49.870278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08c802-70c5-4db2-849a-53b08e21285c service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:49.870571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08c802-70c5-4db2-849a-53b08e21285c service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:49.870854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08c802-70c5-4db2-849a-53b08e21285c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:49.880471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08c802-70c5-4db2-849a-53b08e21285c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:49.882129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08c802-70c5-4db2-849a-53b08e21285c service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:49.894014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 683/1383] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:52.443286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db846a-bf2f-49b9-a71b-786ea90fd36a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:52.443907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db846a-bf2f-49b9-a71b-786ea90fd36a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:52.443907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db846a-bf2f-49b9-a71b-786ea90fd36a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:52.446588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 701/1384] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:52.455057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a50b-6a51-4c2d-94eb-e4e6b522f0d8 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:52.455057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a50b-6a51-4c2d-94eb-e4e6b522f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:52.455057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a50b-6a51-4c2d-94eb-e4e6b522f0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:52.474881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c811a50b-6a51-4c2d-94eb-e4e6b522f0d8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:52.476146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c811a50b-6a51-4c2d-94eb-e4e6b522f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:52.484724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 684/1385] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:52.536482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db846a-bf2f-49b9-a71b-786ea90fd36a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:52.551151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db846a-bf2f-49b9-a71b-786ea90fd36a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:52.557766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2241c-3776-41f3-8b73-265a9e01c88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:52.558395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2241c-3776-41f3-8b73-265a9e01c88b service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:52.558930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2241c-3776-41f3-8b73-265a9e01c88b service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:52.559205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2241c-3776-41f3-8b73-265a9e01c88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:52.567476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2241c-3776-41f3-8b73-265a9e01c88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:52.569079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2241c-3776-41f3-8b73-265a9e01c88b service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:52.578635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 702/1386] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:55.173525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca91941-ab64-486f-a750-d8bcede3e0fe None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:55.174065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca91941-ab64-486f-a750-d8bcede3e0fe None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:55.174259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca91941-ab64-486f-a750-d8bcede3e0fe None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:55.176677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 685/1387] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:01:55.182877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca6f6-9394-4f59-ae40-3bf6625e667c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:55.183312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca6f6-9394-4f59-ae40-3bf6625e667c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:55.183695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca6f6-9394-4f59-ae40-3bf6625e667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:55.202209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-cd9ca6f6-9394-4f59-ae40-3bf6625e667c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:55.203464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cd9ca6f6-9394-4f59-ae40-3bf6625e667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:55.211524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 703/1388] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:55.256681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca91941-ab64-486f-a750-d8bcede3e0fe None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:55.272387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca91941-ab64-486f-a750-d8bcede3e0fe None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:55.279075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a70cc9-b363-4ab4-8417-6aae12095fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:55.279986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a70cc9-b363-4ab4-8417-6aae12095fc0 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:55.280417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a70cc9-b363-4ab4-8417-6aae12095fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:55.280770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a70cc9-b363-4ab4-8417-6aae12095fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:55.290270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a70cc9-b363-4ab4-8417-6aae12095fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:55.291895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a70cc9-b363-4ab4-8417-6aae12095fc0 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:55.302181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 686/1389] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:01:57.932917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dabb64-81ca-409e-bc5c-03566c2ed441 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:57.933778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dabb64-81ca-409e-bc5c-03566c2ed441 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:57.933778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dabb64-81ca-409e-bc5c-03566c2ed441 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:57.935692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 704/1390] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:01:57.942201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d871d-4ae2-4565-9215-6f6b8e84124e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:57.942826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d871d-4ae2-4565-9215-6f6b8e84124e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:57.943084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d871d-4ae2-4565-9215-6f6b8e84124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:57.966223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-428d871d-4ae2-4565-9215-6f6b8e84124e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:01:57.967803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-428d871d-4ae2-4565-9215-6f6b8e84124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:01:57.982474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 687/1391] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:01:58.030522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dabb64-81ca-409e-bc5c-03566c2ed441 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:01:58.048389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dabb64-81ca-409e-bc5c-03566c2ed441 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:01:58.055377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221c6fd-b2c0-4514-b029-94b2706b1f07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:01:58.056095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c6fd-b2c0-4514-b029-94b2706b1f07 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:01:58.056391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c6fd-b2c0-4514-b029-94b2706b1f07 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:01:58.056684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221c6fd-b2c0-4514-b029-94b2706b1f07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:01:58.066259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c6fd-b2c0-4514-b029-94b2706b1f07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:01:58.067988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221c6fd-b2c0-4514-b029-94b2706b1f07 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:01:58.084022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 705/1392] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:00.231352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c2b44-a9d8-4421-af61-40a073da361d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.231965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c2b44-a9d8-4421-af61-40a073da361d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.232075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c2b44-a9d8-4421-af61-40a073da361d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.233898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 688/1393] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:00.239158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c47e73-ab67-4863-8bf3-efa7db1f41d4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.239635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c47e73-ab67-4863-8bf3-efa7db1f41d4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.239881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c47e73-ab67-4863-8bf3-efa7db1f41d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.259847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-56c47e73-ab67-4863-8bf3-efa7db1f41d4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:00.261069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-56c47e73-ab67-4863-8bf3-efa7db1f41d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:00.268967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 706/1394] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:00.327714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00729029-aadb-487a-832c-bbd859aa67fc None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.328044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00729029-aadb-487a-832c-bbd859aa67fc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.328333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00729029-aadb-487a-832c-bbd859aa67fc None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.330360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 689/1395] 10.222.0.91 () {54 vars in 962 bytes} [Mon Feb 21 01:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:00.335721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df8f3-16d1-43a5-bb3e-135287c006e1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.336069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df8f3-16d1-43a5-bb3e-135287c006e1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.336351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103df8f3-16d1-43a5-bb3e-135287c006e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.390231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-103df8f3-16d1-43a5-bb3e-135287c006e1 None None] MFA Rules not processed for user `14e036fb8f904380a1f0d15e085f3948`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:00.391440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-103df8f3-16d1-43a5-bb3e-135287c006e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:00.451507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 707/1396] 10.222.0.91 () {58 vars in 1059 bytes} [Mon Feb 21 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:00.458808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00729029-aadb-487a-832c-bbd859aa67fc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:00.469218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00729029-aadb-487a-832c-bbd859aa67fc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:00.472842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c9164-466d-4c5d-9326-6242b6665deb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:00.473455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9164-466d-4c5d-9326-6242b6665deb service glance] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.473738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9164-466d-4c5d-9326-6242b6665deb service glance] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.474012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c9164-466d-4c5d-9326-6242b6665deb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.483422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c9164-466d-4c5d-9326-6242b6665deb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:00.484798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c9164-466d-4c5d-9326-6242b6665deb service glance] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:00.494502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 690/1397] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:00.693415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed421b8-b317-4ad4-ba1f-d553ac3e88c3 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.693837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed421b8-b317-4ad4-ba1f-d553ac3e88c3 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.694134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed421b8-b317-4ad4-ba1f-d553ac3e88c3 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.696082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 708/1398] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:00.701652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9374b-9fd6-406f-b474-723341c0e8cb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.701938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9374b-9fd6-406f-b474-723341c0e8cb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.702217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9374b-9fd6-406f-b474-723341c0e8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.720105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-08c9374b-9fd6-406f-b474-723341c0e8cb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:00.722999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-08c9374b-9fd6-406f-b474-723341c0e8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:00.730551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 691/1399] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:00.775939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed421b8-b317-4ad4-ba1f-d553ac3e88c3 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:00.791257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed421b8-b317-4ad4-ba1f-d553ac3e88c3 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:00.796867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5b32d-8263-4c85-b6a0-9ba4a9e1089b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:00.797474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b32d-8263-4c85-b6a0-9ba4a9e1089b service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:00.797759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b32d-8263-4c85-b6a0-9ba4a9e1089b service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:00.798040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b32d-8263-4c85-b6a0-9ba4a9e1089b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:00.807430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5b32d-8263-4c85-b6a0-9ba4a9e1089b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:00.809368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5b32d-8263-4c85-b6a0-9ba4a9e1089b service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:00.823318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 709/1400] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:01.058114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e97af-b7d8-48d4-9b44-babdc4183e7d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:01.058659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e97af-b7d8-48d4-9b44-babdc4183e7d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:01.058944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e97af-b7d8-48d4-9b44-babdc4183e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:01.113338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e98e97af-b7d8-48d4-9b44-babdc4183e7d None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:01.114626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e98e97af-b7d8-48d4-9b44-babdc4183e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:01.184122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 692/1401] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:01.230429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34829-6fb6-4027-bc3a-4583a995b6ee None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:01.230721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34829-6fb6-4027-bc3a-4583a995b6ee None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:01.231007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b34829-6fb6-4027-bc3a-4583a995b6ee None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:01.233074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 710/1402] 10.222.0.91 () {54 vars in 942 bytes} [Mon Feb 21 01:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:01.239853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82497-b61e-4ed5-8ec5-55eb23103a32 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:01.242950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82497-b61e-4ed5-8ec5-55eb23103a32 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:01.242950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c82497-b61e-4ed5-8ec5-55eb23103a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:01.293198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-77c82497-b61e-4ed5-8ec5-55eb23103a32 None None] MFA Rules not processed for user `bde8ac2fb5804342b943a6999b23fedd`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:01.294388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-77c82497-b61e-4ed5-8ec5-55eb23103a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:01.367128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 693/1403] 10.222.0.91 () {58 vars in 1039 bytes} [Mon Feb 21 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:01.376940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b34829-6fb6-4027-bc3a-4583a995b6ee None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:01.391825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b34829-6fb6-4027-bc3a-4583a995b6ee None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:01.397018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896dbf-8a20-4755-931a-3285dcc7a382 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:01.397659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896dbf-8a20-4755-931a-3285dcc7a382 service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:01.397943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896dbf-8a20-4755-931a-3285dcc7a382 service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:01.398224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896dbf-8a20-4755-931a-3285dcc7a382 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:01.407417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31896dbf-8a20-4755-931a-3285dcc7a382 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:01.409057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31896dbf-8a20-4755-931a-3285dcc7a382 service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:01.417773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 711/1404] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:02:03.601831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727834a-8f18-4b15-a012-7b0931e90c88 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:03.602455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727834a-8f18-4b15-a012-7b0931e90c88 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:03.602455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727834a-8f18-4b15-a012-7b0931e90c88 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:03.608645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 694/1405] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:02:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:03.610090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143683-e615-4044-893c-cf3f3a33f873 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:03.610541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143683-e615-4044-893c-cf3f3a33f873 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:03.610635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc143683-e615-4044-893c-cf3f3a33f873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:03.629749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-bc143683-e615-4044-893c-cf3f3a33f873 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:03.630975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bc143683-e615-4044-893c-cf3f3a33f873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:03.645795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 712/1406] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:03.693549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727834a-8f18-4b15-a012-7b0931e90c88 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:03.717582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727834a-8f18-4b15-a012-7b0931e90c88 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:03.723690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36186293-6697-4ac7-bf96-79c4aa4d63de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:03.724378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186293-6697-4ac7-bf96-79c4aa4d63de service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:03.724654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186293-6697-4ac7-bf96-79c4aa4d63de service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:03.724937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36186293-6697-4ac7-bf96-79c4aa4d63de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:03.736143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186293-6697-4ac7-bf96-79c4aa4d63de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:03.738232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36186293-6697-4ac7-bf96-79c4aa4d63de service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:03.749939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 695/1407] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:06.664179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f63b-fb02-451b-a70d-b405bcf8c465 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:06.664767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f63b-fb02-451b-a70d-b405bcf8c465 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:06.664767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f63b-fb02-451b-a70d-b405bcf8c465 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:06.666915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 713/1408] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:06.672136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b39a5-4742-4edb-ac84-db77f2dd94e3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:06.672583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b39a5-4742-4edb-ac84-db77f2dd94e3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:06.672689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b39a5-4742-4edb-ac84-db77f2dd94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:06.692310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-663b39a5-4742-4edb-ac84-db77f2dd94e3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:06.693729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-663b39a5-4742-4edb-ac84-db77f2dd94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:06.712271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 696/1409] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:06.753300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f63b-fb02-451b-a70d-b405bcf8c465 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:06.770033 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f63b-fb02-451b-a70d-b405bcf8c465 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:06.777267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9048-51be-4dff-a2f2-95281e326696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:06.778149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9048-51be-4dff-a2f2-95281e326696 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:06.778612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9048-51be-4dff-a2f2-95281e326696 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:06.779086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9048-51be-4dff-a2f2-95281e326696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:06.788474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9048-51be-4dff-a2f2-95281e326696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:06.790274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9048-51be-4dff-a2f2-95281e326696 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:06.800498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 714/1410] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:26.284110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab69c-40db-499b-9c2e-a09412d40f1d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:26.284748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab69c-40db-499b-9c2e-a09412d40f1d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:26.284748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ab69c-40db-499b-9c2e-a09412d40f1d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:26.286449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 697/1411] 10.222.0.91 () {54 vars in 918 bytes} [Mon Feb 21 01:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:26.291691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dce17e-219d-45b6-bf86-7d6067c53d84 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:26.295179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dce17e-219d-45b6-bf86-7d6067c53d84 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:26.295179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dce17e-219d-45b6-bf86-7d6067c53d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:26.310806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e8dce17e-219d-45b6-bf86-7d6067c53d84 None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:26.312040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e8dce17e-219d-45b6-bf86-7d6067c53d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:26.321207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 715/1412] 10.222.0.91 () {58 vars in 1015 bytes} [Mon Feb 21 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:26.335481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2151d-0eb9-46cb-83c7-d6aea8d5c7d5 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:26.335780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2151d-0eb9-46cb-83c7-d6aea8d5c7d5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:26.336232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2151d-0eb9-46cb-83c7-d6aea8d5c7d5 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:26.338036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 698/1413] 10.222.0.91 () {54 vars in 918 bytes} [Mon Feb 21 01:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:26.342622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a145e1-dd6c-41fa-99ea-6bf50f568eb5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:26.342910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a145e1-dd6c-41fa-99ea-6bf50f568eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:26.343214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a145e1-dd6c-41fa-99ea-6bf50f568eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:26.361997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e2a145e1-dd6c-41fa-99ea-6bf50f568eb5 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:26.363225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e2a145e1-dd6c-41fa-99ea-6bf50f568eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:26.373752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 716/1414] 10.222.0.91 () {58 vars in 1015 bytes} [Mon Feb 21 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:29.181443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312891f2-02f7-40c0-8e57-b2d921a9fa3e None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:29.182297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312891f2-02f7-40c0-8e57-b2d921a9fa3e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:29.182297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312891f2-02f7-40c0-8e57-b2d921a9fa3e None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:29.184033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 699/1415] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:29.189281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332268-b071-4ae8-bc58-d3fed8a57b5c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:29.189694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332268-b071-4ae8-bc58-d3fed8a57b5c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:29.189847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22332268-b071-4ae8-bc58-d3fed8a57b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:29.208147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-22332268-b071-4ae8-bc58-d3fed8a57b5c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:29.209344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-22332268-b071-4ae8-bc58-d3fed8a57b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:29.217779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 717/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:02:29.261258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312891f2-02f7-40c0-8e57-b2d921a9fa3e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:29.275826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312891f2-02f7-40c0-8e57-b2d921a9fa3e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:29.281248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa04bd4-beb1-49a2-87cd-ea36921ea910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:29.281867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04bd4-beb1-49a2-87cd-ea36921ea910 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:29.282148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04bd4-beb1-49a2-87cd-ea36921ea910 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:29.282423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04bd4-beb1-49a2-87cd-ea36921ea910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:29.291085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa04bd4-beb1-49a2-87cd-ea36921ea910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:29.292695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa04bd4-beb1-49a2-87cd-ea36921ea910 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:29.301723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 700/1417] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:30.677791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3555c5-1e2e-4b3f-ae2d-443389f70053 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:30.678328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3555c5-1e2e-4b3f-ae2d-443389f70053 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:30.678328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3555c5-1e2e-4b3f-ae2d-443389f70053 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:30.680561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 718/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:30.685845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9804-6baa-4f38-8c2c-483e3b835f08 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:30.686294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9804-6baa-4f38-8c2c-483e3b835f08 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:30.686432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf9804-6baa-4f38-8c2c-483e3b835f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:30.705373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2ebf9804-6baa-4f38-8c2c-483e3b835f08 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:30.706581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2ebf9804-6baa-4f38-8c2c-483e3b835f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:30.715341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 701/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:30.876687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3555c5-1e2e-4b3f-ae2d-443389f70053 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:30.891551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3555c5-1e2e-4b3f-ae2d-443389f70053 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:30.896926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d26a80-3183-47e8-bfe1-a74bfe6e5fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:30.897621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d26a80-3183-47e8-bfe1-a74bfe6e5fc9 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:30.898212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d26a80-3183-47e8-bfe1-a74bfe6e5fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:30.898338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d26a80-3183-47e8-bfe1-a74bfe6e5fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:30.906393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d26a80-3183-47e8-bfe1-a74bfe6e5fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:30.908003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d26a80-3183-47e8-bfe1-a74bfe6e5fc9 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:30.917207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 719/1420] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:32.253114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5913-1ab1-4b8c-b1c9-721be18d5ea2 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:32.253684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5913-1ab1-4b8c-b1c9-721be18d5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:32.253684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5913-1ab1-4b8c-b1c9-721be18d5ea2 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:32.255452 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 702/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:32.260781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f365-fea8-4e8f-aa98-8b707ff95470 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:32.261235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f365-fea8-4e8f-aa98-8b707ff95470 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:32.261362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95f365-fea8-4e8f-aa98-8b707ff95470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:32.279433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7c95f365-fea8-4e8f-aa98-8b707ff95470 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:32.280678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7c95f365-fea8-4e8f-aa98-8b707ff95470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:32.289603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 720/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:32.445604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5913-1ab1-4b8c-b1c9-721be18d5ea2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:32.460467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5913-1ab1-4b8c-b1c9-721be18d5ea2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:32.466178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25e3bd-0362-47d5-8b23-7d313801c6ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:32.466813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e3bd-0362-47d5-8b23-7d313801c6ce service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:32.467101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e3bd-0362-47d5-8b23-7d313801c6ce service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:32.467377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25e3bd-0362-47d5-8b23-7d313801c6ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:32.476306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e3bd-0362-47d5-8b23-7d313801c6ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:32.478028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25e3bd-0362-47d5-8b23-7d313801c6ce service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:32.487465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 703/1423] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:33.833587 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9037-c59c-424a-85b7-913d2e4de1f5 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:33.834145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9037-c59c-424a-85b7-913d2e4de1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:33.834145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c9037-c59c-424a-85b7-913d2e4de1f5 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:33.836504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 721/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:33.841575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea431e2-0a29-49af-b97c-ed19b1060467 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:33.842042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea431e2-0a29-49af-b97c-ed19b1060467 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:33.842154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea431e2-0a29-49af-b97c-ed19b1060467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:33.860416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2ea431e2-0a29-49af-b97c-ed19b1060467 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:33.861674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2ea431e2-0a29-49af-b97c-ed19b1060467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:33.870263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 704/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:34.022413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c9037-c59c-424a-85b7-913d2e4de1f5 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:34.036828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c9037-c59c-424a-85b7-913d2e4de1f5 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:34.042274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4baa30-7e6f-4ba4-9b3d-c9e2ae81d67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:34.042902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4baa30-7e6f-4ba4-9b3d-c9e2ae81d67d service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:34.043187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4baa30-7e6f-4ba4-9b3d-c9e2ae81d67d service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:34.043469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4baa30-7e6f-4ba4-9b3d-c9e2ae81d67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:34.051470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4baa30-7e6f-4ba4-9b3d-c9e2ae81d67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:34.053077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4baa30-7e6f-4ba4-9b3d-c9e2ae81d67d service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:34.063290 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 722/1426] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:35.395606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4fda-1d67-4880-b5f3-a81161a0bde2 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:35.396282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4fda-1d67-4880-b5f3-a81161a0bde2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:35.396282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4fda-1d67-4880-b5f3-a81161a0bde2 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:35.398079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 705/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:35.403052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397586-1598-45e4-9188-9e3399323450 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:35.403470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397586-1598-45e4-9188-9e3399323450 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:35.403604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e397586-1598-45e4-9188-9e3399323450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:35.421575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0e397586-1598-45e4-9188-9e3399323450 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:35.422737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0e397586-1598-45e4-9188-9e3399323450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:35.431056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 723/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:35.590857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4fda-1d67-4880-b5f3-a81161a0bde2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:35.605431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4fda-1d67-4880-b5f3-a81161a0bde2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:35.610906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db944296-1425-4933-ad4a-113847a65c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:35.611470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db944296-1425-4933-ad4a-113847a65c0f service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:35.611756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db944296-1425-4933-ad4a-113847a65c0f service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:35.612064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db944296-1425-4933-ad4a-113847a65c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:35.620905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db944296-1425-4933-ad4a-113847a65c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:35.622491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db944296-1425-4933-ad4a-113847a65c0f service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:35.633232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 706/1429] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:37.002841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379cb00-6bc4-4a04-9d28-001c0fa32e8d None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:37.003423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379cb00-6bc4-4a04-9d28-001c0fa32e8d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:37.003423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379cb00-6bc4-4a04-9d28-001c0fa32e8d None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:37.005273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 724/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:37.010317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e174-775b-4afb-b368-875c2a164dfb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:37.010749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e174-775b-4afb-b368-875c2a164dfb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:37.010906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252e174-775b-4afb-b368-875c2a164dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:37.029211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-0252e174-775b-4afb-b368-875c2a164dfb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:37.030424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0252e174-775b-4afb-b368-875c2a164dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:37.039451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 707/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:37.203311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379cb00-6bc4-4a04-9d28-001c0fa32e8d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:37.218766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379cb00-6bc4-4a04-9d28-001c0fa32e8d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:37.228114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59d4f2-1b6b-4ac1-b1e6-53904abef292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:37.228762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59d4f2-1b6b-4ac1-b1e6-53904abef292 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:37.229043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59d4f2-1b6b-4ac1-b1e6-53904abef292 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:37.229319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59d4f2-1b6b-4ac1-b1e6-53904abef292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:37.238008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59d4f2-1b6b-4ac1-b1e6-53904abef292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:37.239581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59d4f2-1b6b-4ac1-b1e6-53904abef292 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:37.249857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 725/1432] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:38.550488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43326967-47a3-46b2-bceb-171e91f71afc None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:38.551037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43326967-47a3-46b2-bceb-171e91f71afc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:38.551037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43326967-47a3-46b2-bceb-171e91f71afc None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:38.552875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 708/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:38.559003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11416-d833-4108-8507-f0f649c17ad8 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:38.559487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11416-d833-4108-8507-f0f649c17ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:38.559594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b11416-d833-4108-8507-f0f649c17ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:38.578730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d9b11416-d833-4108-8507-f0f649c17ad8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:38.579968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d9b11416-d833-4108-8507-f0f649c17ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:38.587815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 726/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:38.739919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43326967-47a3-46b2-bceb-171e91f71afc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:38.755048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43326967-47a3-46b2-bceb-171e91f71afc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:38.761372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43859ab-c1df-4863-9688-7d08c07568b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:38.762012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43859ab-c1df-4863-9688-7d08c07568b4 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:38.762288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43859ab-c1df-4863-9688-7d08c07568b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:38.762566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43859ab-c1df-4863-9688-7d08c07568b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:38.776005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43859ab-c1df-4863-9688-7d08c07568b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:38.777628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43859ab-c1df-4863-9688-7d08c07568b4 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:38.787767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 709/1435] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:40.161998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317f5b-dc5a-4ddf-a4f7-3f9abc426d02 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:40.162578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317f5b-dc5a-4ddf-a4f7-3f9abc426d02 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:40.162578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88317f5b-dc5a-4ddf-a4f7-3f9abc426d02 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:40.165012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 727/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:40.170228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a653b-b3d8-487f-bf05-3ead2b391070 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:40.170670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a653b-b3d8-487f-bf05-3ead2b391070 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:40.170893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a653b-b3d8-487f-bf05-3ead2b391070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:40.190651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a75a653b-b3d8-487f-bf05-3ead2b391070 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:40.191885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a75a653b-b3d8-487f-bf05-3ead2b391070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:40.200765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 710/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:40.354794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317f5b-dc5a-4ddf-a4f7-3f9abc426d02 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:40.369606 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88317f5b-dc5a-4ddf-a4f7-3f9abc426d02 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:40.375043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702a7fb-ce10-4cd0-86bb-ef6d8a2a2ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:40.375672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702a7fb-ce10-4cd0-86bb-ef6d8a2a2ac2 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:40.375997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702a7fb-ce10-4cd0-86bb-ef6d8a2a2ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:40.376284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702a7fb-ce10-4cd0-86bb-ef6d8a2a2ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:40.385276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702a7fb-ce10-4cd0-86bb-ef6d8a2a2ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:40.386859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702a7fb-ce10-4cd0-86bb-ef6d8a2a2ac2 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:40.396093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 728/1438] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:41.742869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a726-9880-4c70-a3f5-705aa8b7addb None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:41.743457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a726-9880-4c70-a3f5-705aa8b7addb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:41.743457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06a726-9880-4c70-a3f5-705aa8b7addb None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:41.745230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 711/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:41.750450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86aab2-8db1-4923-b256-31ba2fd00b81 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:41.750881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86aab2-8db1-4923-b256-31ba2fd00b81 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:41.751036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86aab2-8db1-4923-b256-31ba2fd00b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:41.769766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-db86aab2-8db1-4923-b256-31ba2fd00b81 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:41.770956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-db86aab2-8db1-4923-b256-31ba2fd00b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:41.780286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 729/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:41.930535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06a726-9880-4c70-a3f5-705aa8b7addb None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:41.945712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06a726-9880-4c70-a3f5-705aa8b7addb None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:41.951063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801aa6d-a405-483b-bbc7-96dd5cb036a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:41.951693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801aa6d-a405-483b-bbc7-96dd5cb036a3 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:41.952011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801aa6d-a405-483b-bbc7-96dd5cb036a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:41.952290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801aa6d-a405-483b-bbc7-96dd5cb036a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:41.961119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801aa6d-a405-483b-bbc7-96dd5cb036a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:41.962690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801aa6d-a405-483b-bbc7-96dd5cb036a3 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:41.972334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 712/1441] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:44.221536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeeb64-3465-449f-8473-d9dd26677092 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:44.222124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeeb64-3465-449f-8473-d9dd26677092 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:44.222124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeeb64-3465-449f-8473-d9dd26677092 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:44.223895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 730/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:44.230102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78b58-e08a-4f9c-9eab-580a07b31ca2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:44.230609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78b58-e08a-4f9c-9eab-580a07b31ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:44.230726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78b58-e08a-4f9c-9eab-580a07b31ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:44.249628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-55d78b58-e08a-4f9c-9eab-580a07b31ca2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:44.250493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-55d78b58-e08a-4f9c-9eab-580a07b31ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:44.258572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 713/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:44.297119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeeb64-3465-449f-8473-d9dd26677092 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:44.308840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeeb64-3465-449f-8473-d9dd26677092 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:44.312452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a81f-022a-472a-bfb8-66dc104917fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:44.313087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a81f-022a-472a-bfb8-66dc104917fa service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:44.313371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a81f-022a-472a-bfb8-66dc104917fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:44.313649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a81f-022a-472a-bfb8-66dc104917fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:44.323406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a81f-022a-472a-bfb8-66dc104917fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:44.324897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a81f-022a-472a-bfb8-66dc104917fa service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:44.335433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 731/1444] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:46.826382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccb3a3-b2a1-433d-b2fe-5cc15facc254 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:46.826983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccb3a3-b2a1-433d-b2fe-5cc15facc254 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:46.826983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccb3a3-b2a1-433d-b2fe-5cc15facc254 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:46.828789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 714/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:46.834813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f363307-7c67-4562-b26d-64ef8a0d250e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:46.837009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f363307-7c67-4562-b26d-64ef8a0d250e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:46.837009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f363307-7c67-4562-b26d-64ef8a0d250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:46.854364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8f363307-7c67-4562-b26d-64ef8a0d250e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:46.855502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8f363307-7c67-4562-b26d-64ef8a0d250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:46.863465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 732/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:46.902111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccb3a3-b2a1-433d-b2fe-5cc15facc254 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:46.913697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccb3a3-b2a1-433d-b2fe-5cc15facc254 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:46.917562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf473b2e-790a-4150-a96c-26265541fcde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:46.918190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf473b2e-790a-4150-a96c-26265541fcde service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:46.918477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf473b2e-790a-4150-a96c-26265541fcde service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:46.918758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf473b2e-790a-4150-a96c-26265541fcde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:46.927732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf473b2e-790a-4150-a96c-26265541fcde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:46.929425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf473b2e-790a-4150-a96c-26265541fcde service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:46.939082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 715/1447] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:49.626275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b397aa7-4a4c-4b0c-87da-45da80e0d2d8 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:49.626796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b397aa7-4a4c-4b0c-87da-45da80e0d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:49.626796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b397aa7-4a4c-4b0c-87da-45da80e0d2d8 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:49.628559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 733/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:49.634287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c7f-70f9-41cf-8fe8-b572e2affcc2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:49.635047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c7f-70f9-41cf-8fe8-b572e2affcc2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:49.635221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a2c7f-70f9-41cf-8fe8-b572e2affcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:49.653779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-489a2c7f-70f9-41cf-8fe8-b572e2affcc2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:49.654983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-489a2c7f-70f9-41cf-8fe8-b572e2affcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:49.663483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 716/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:49.704129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b397aa7-4a4c-4b0c-87da-45da80e0d2d8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:49.717948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b397aa7-4a4c-4b0c-87da-45da80e0d2d8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:49.722444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a11fe9-6a52-4438-b510-97e533007733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:49.723154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a11fe9-6a52-4438-b510-97e533007733 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:49.723443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a11fe9-6a52-4438-b510-97e533007733 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:49.723724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a11fe9-6a52-4438-b510-97e533007733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:49.734811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a11fe9-6a52-4438-b510-97e533007733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:49.736362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a11fe9-6a52-4438-b510-97e533007733 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:49.746521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 734/1450] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:52.211721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8f1b-8969-4f6f-b545-8b094cf5155d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:52.212441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8f1b-8969-4f6f-b545-8b094cf5155d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:52.212441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8f1b-8969-4f6f-b545-8b094cf5155d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:52.215262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 717/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:52.221967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec80b-b5a4-40af-9234-9efab5ab6361 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:52.222532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec80b-b5a4-40af-9234-9efab5ab6361 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:52.222532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec80b-b5a4-40af-9234-9efab5ab6361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:52.242976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-456ec80b-b5a4-40af-9234-9efab5ab6361 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:52.244245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-456ec80b-b5a4-40af-9234-9efab5ab6361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:52.253515 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 735/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:52.292559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8f1b-8969-4f6f-b545-8b094cf5155d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:52.303703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e8f1b-8969-4f6f-b545-8b094cf5155d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:52.307496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03212663-71de-4f3f-a841-9a787932cdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:52.308148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212663-71de-4f3f-a841-9a787932cdde service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:52.308430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212663-71de-4f3f-a841-9a787932cdde service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:52.308705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03212663-71de-4f3f-a841-9a787932cdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:52.317565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03212663-71de-4f3f-a841-9a787932cdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:52.319175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03212663-71de-4f3f-a841-9a787932cdde service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:52.328709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 718/1453] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:54.784454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e515a4-621e-4bcc-836d-6f3da63de3bc None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:54.785098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e515a4-621e-4bcc-836d-6f3da63de3bc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:54.785098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e515a4-621e-4bcc-836d-6f3da63de3bc None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:54.786808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 736/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:54.792823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333b06-7aef-4885-ae79-309106102ee4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:54.793323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333b06-7aef-4885-ae79-309106102ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:54.793512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd333b06-7aef-4885-ae79-309106102ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:54.812226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-dd333b06-7aef-4885-ae79-309106102ee4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:54.813436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dd333b06-7aef-4885-ae79-309106102ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:54.822029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 719/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:54.860944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e515a4-621e-4bcc-836d-6f3da63de3bc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:54.872038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e515a4-621e-4bcc-836d-6f3da63de3bc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:54.875552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84fe8a-4b06-4d09-8ad9-cbb95a8327b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:54.876212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84fe8a-4b06-4d09-8ad9-cbb95a8327b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:54.876489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84fe8a-4b06-4d09-8ad9-cbb95a8327b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:54.876763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84fe8a-4b06-4d09-8ad9-cbb95a8327b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:54.886448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84fe8a-4b06-4d09-8ad9-cbb95a8327b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:54.887896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84fe8a-4b06-4d09-8ad9-cbb95a8327b0 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:54.897183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 737/1456] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:57.269083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a552-fa44-4178-bfd6-fe31d0f94de7 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:57.269667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a552-fa44-4178-bfd6-fe31d0f94de7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:57.269667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92a552-fa44-4178-bfd6-fe31d0f94de7 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:57.272128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 720/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:57.277770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2c92-c8e6-42f6-ac18-0b51d6bf6273 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:57.278184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2c92-c8e6-42f6-ac18-0b51d6bf6273 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:57.278329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2c92-c8e6-42f6-ac18-0b51d6bf6273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:57.296689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-813d2c92-c8e6-42f6-ac18-0b51d6bf6273 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:57.297881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-813d2c92-c8e6-42f6-ac18-0b51d6bf6273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:57.306145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 738/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:57.344880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92a552-fa44-4178-bfd6-fe31d0f94de7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:57.356820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92a552-fa44-4178-bfd6-fe31d0f94de7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:57.360395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16c09-5b7b-4ed5-b628-5add8c4bbb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:57.361030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16c09-5b7b-4ed5-b628-5add8c4bbb4e service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:57.361313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16c09-5b7b-4ed5-b628-5add8c4bbb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:57.361589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16c09-5b7b-4ed5-b628-5add8c4bbb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:57.370814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be16c09-5b7b-4ed5-b628-5add8c4bbb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:57.372298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be16c09-5b7b-4ed5-b628-5add8c4bbb4e service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:57.382147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 721/1459] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:02:59.766940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d225da-271c-4468-9317-b77f999b1349 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:59.767508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d225da-271c-4468-9317-b77f999b1349 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:59.767508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d225da-271c-4468-9317-b77f999b1349 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:59.769344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 739/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:02:59.775472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad0db-57dd-477a-afd3-a6dba2233205 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:59.775934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad0db-57dd-477a-afd3-a6dba2233205 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:59.776084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad0db-57dd-477a-afd3-a6dba2233205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:59.794720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e4dad0db-57dd-477a-afd3-a6dba2233205 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:02:59.795969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e4dad0db-57dd-477a-afd3-a6dba2233205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:02:59.804315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 722/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:02:59.843418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d225da-271c-4468-9317-b77f999b1349 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:02:59.854514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d225da-271c-4468-9317-b77f999b1349 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:02:59.858081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354b2a6-497f-4617-a022-f79ff03cbec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:02:59.858712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b2a6-497f-4617-a022-f79ff03cbec2 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:02:59.859003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b2a6-497f-4617-a022-f79ff03cbec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:02:59.859286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354b2a6-497f-4617-a022-f79ff03cbec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:02:59.868629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b2a6-497f-4617-a022-f79ff03cbec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:02:59.870061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354b2a6-497f-4617-a022-f79ff03cbec2 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:02:59.879601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 740/1462] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:02.247637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c35e6-c012-4748-9a38-40c61eeeb6a6 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:02.248205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c35e6-c012-4748-9a38-40c61eeeb6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:02.248327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c35e6-c012-4748-9a38-40c61eeeb6a6 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:02.249994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 723/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:02.255301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441994b8-392d-486d-844f-fab957eb8726 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:02.255800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441994b8-392d-486d-844f-fab957eb8726 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:02.255924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441994b8-392d-486d-844f-fab957eb8726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:02.273629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-441994b8-392d-486d-844f-fab957eb8726 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:02.274799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-441994b8-392d-486d-844f-fab957eb8726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:02.282427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 741/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:02.320202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c35e6-c012-4748-9a38-40c61eeeb6a6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:02.330916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c35e6-c012-4748-9a38-40c61eeeb6a6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:02.335132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bef7d5-3d89-48cd-840b-fe7e9252bdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:02.335737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bef7d5-3d89-48cd-840b-fe7e9252bdaa service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:02.336078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bef7d5-3d89-48cd-840b-fe7e9252bdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:02.336360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bef7d5-3d89-48cd-840b-fe7e9252bdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:02.345293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bef7d5-3d89-48cd-840b-fe7e9252bdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:02.346713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bef7d5-3d89-48cd-840b-fe7e9252bdaa service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:02.358266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 724/1465] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:04.799744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47568dd-4e6d-4bad-9edb-86cc647d63f7 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:04.800355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47568dd-4e6d-4bad-9edb-86cc647d63f7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:04.800355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47568dd-4e6d-4bad-9edb-86cc647d63f7 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:04.802725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 742/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:04.809071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e037c-41ad-4767-8587-0b6e140a3c4c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:04.809536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e037c-41ad-4767-8587-0b6e140a3c4c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:04.809644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e037c-41ad-4767-8587-0b6e140a3c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:04.828266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7c7e037c-41ad-4767-8587-0b6e140a3c4c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:04.829485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7c7e037c-41ad-4767-8587-0b6e140a3c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:04.837686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 725/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:04.874504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47568dd-4e6d-4bad-9edb-86cc647d63f7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:04.885937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47568dd-4e6d-4bad-9edb-86cc647d63f7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:04.889523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eaa1da-d134-4d20-87d2-3c3ca40eb0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:04.890150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaa1da-d134-4d20-87d2-3c3ca40eb0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:04.890435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaa1da-d134-4d20-87d2-3c3ca40eb0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:04.890728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eaa1da-d134-4d20-87d2-3c3ca40eb0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:04.899903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaa1da-d134-4d20-87d2-3c3ca40eb0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:04.902484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eaa1da-d134-4d20-87d2-3c3ca40eb0b6 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:04.910465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 743/1468] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:07.283362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe797d-7d7c-491e-b73e-360b3e140968 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:07.283975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe797d-7d7c-491e-b73e-360b3e140968 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:07.283975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe797d-7d7c-491e-b73e-360b3e140968 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:07.285831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 726/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:07.295580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2d2c7-eddf-487c-897d-499fbf8fc8d1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:07.296129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2d2c7-eddf-487c-897d-499fbf8fc8d1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:07.296241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2d2c7-eddf-487c-897d-499fbf8fc8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:07.314562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-fad2d2c7-eddf-487c-897d-499fbf8fc8d1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:07.315774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fad2d2c7-eddf-487c-897d-499fbf8fc8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:07.323596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 744/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:07.361740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe797d-7d7c-491e-b73e-360b3e140968 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:07.373005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe797d-7d7c-491e-b73e-360b3e140968 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:07.376603 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4aad6f-a732-4eda-91ce-1497ff1c59fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:07.377235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aad6f-a732-4eda-91ce-1497ff1c59fb service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:07.377528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aad6f-a732-4eda-91ce-1497ff1c59fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:07.377836 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4aad6f-a732-4eda-91ce-1497ff1c59fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:07.387517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aad6f-a732-4eda-91ce-1497ff1c59fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:07.388988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4aad6f-a732-4eda-91ce-1497ff1c59fb service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:07.398665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 727/1471] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:28.341144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbccbe8-04db-4505-a7c6-a275552dec45 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:28.341750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbccbe8-04db-4505-a7c6-a275552dec45 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:28.341750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbccbe8-04db-4505-a7c6-a275552dec45 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:28.343448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 745/1472] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:28.349284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffe6a-5299-4990-936e-f567bc92c2ce None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:28.349717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffe6a-5299-4990-936e-f567bc92c2ce None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:28.349924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fffe6a-5299-4990-936e-f567bc92c2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:28.369432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c2fffe6a-5299-4990-936e-f567bc92c2ce None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:28.370640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c2fffe6a-5299-4990-936e-f567bc92c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:28.378733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 728/1473] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:28.427694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3a528-54de-46a0-8b4d-051c948d96db None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:28.428014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3a528-54de-46a0-8b4d-051c948d96db None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:28.428298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3a528-54de-46a0-8b4d-051c948d96db None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:28.430368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 746/1474] 10.222.0.91 () {54 vars in 962 bytes} [Mon Feb 21 01:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:28.435174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08936c-a3a8-4bb1-a2ae-a858d6c34610 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:28.435467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08936c-a3a8-4bb1-a2ae-a858d6c34610 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:28.435753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08936c-a3a8-4bb1-a2ae-a858d6c34610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:28.454562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-eb08936c-a3a8-4bb1-a2ae-a858d6c34610 None None] MFA Rules not processed for user `14e036fb8f904380a1f0d15e085f3948`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:28.455757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-eb08936c-a3a8-4bb1-a2ae-a858d6c34610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:28.463347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 729/1475] 10.222.0.91 () {58 vars in 1059 bytes} [Mon Feb 21 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:28.470686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3a528-54de-46a0-8b4d-051c948d96db None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:28.481800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3a528-54de-46a0-8b4d-051c948d96db None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:28.485460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acfd57-3da1-4f7d-bf06-00547683e041 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:28.486088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acfd57-3da1-4f7d-bf06-00547683e041 service glance] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:28.486375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acfd57-3da1-4f7d-bf06-00547683e041 service glance] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:28.486657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acfd57-3da1-4f7d-bf06-00547683e041 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:28.495949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acfd57-3da1-4f7d-bf06-00547683e041 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:28.497384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5acfd57-3da1-4f7d-bf06-00547683e041 service glance] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:28.507478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 747/1476] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:30.926924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b216d-4909-45d0-9228-9c35d53361de None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:30.927490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b216d-4909-45d0-9228-9c35d53361de None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:30.927490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b216d-4909-45d0-9228-9c35d53361de None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:30.929508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 730/1477] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:30.934984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422ac05-1af3-4fb0-b5db-6fb0440ff01f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:30.935427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422ac05-1af3-4fb0-b5db-6fb0440ff01f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:30.935594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422ac05-1af3-4fb0-b5db-6fb0440ff01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:30.953667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f422ac05-1af3-4fb0-b5db-6fb0440ff01f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:30.954871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f422ac05-1af3-4fb0-b5db-6fb0440ff01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:30.963488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 748/1478] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:30.987756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b216d-4909-45d0-9228-9c35d53361de None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:31.000865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b216d-4909-45d0-9228-9c35d53361de None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:31.005505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e8e15-2e71-4a89-b041-760f8ae3769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:31.006141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8e15-2e71-4a89-b041-760f8ae3769e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:31.006423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8e15-2e71-4a89-b041-760f8ae3769e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:31.006698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e8e15-2e71-4a89-b041-760f8ae3769e admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:31.007415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8e15-2e71-4a89-b041-760f8ae3769e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:31.009261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e8e15-2e71-4a89-b041-760f8ae3769e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:31.023223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 731/1479] 10.222.0.91 () {56 vars in 1108 bytes} [Mon Feb 21 01:03:30 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:03:33.379007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a37a-e328-44f6-8b7e-24cf52b9ef3b None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:33.380342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a37a-e328-44f6-8b7e-24cf52b9ef3b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:33.380342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0a37a-e328-44f6-8b7e-24cf52b9ef3b None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:33.381648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 749/1480] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:33.386962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482877-d9e9-461d-93a5-656d9e361f65 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:33.387412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482877-d9e9-461d-93a5-656d9e361f65 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:33.387524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45482877-d9e9-461d-93a5-656d9e361f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:33.405668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-45482877-d9e9-461d-93a5-656d9e361f65 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:33.406851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-45482877-d9e9-461d-93a5-656d9e361f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:33.415228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 732/1481] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:33.456275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a37a-e328-44f6-8b7e-24cf52b9ef3b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:33.470756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0a37a-e328-44f6-8b7e-24cf52b9ef3b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:33.476733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd65a2-7f3b-4299-90a9-b8ba8dafbaa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:33.477369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd65a2-7f3b-4299-90a9-b8ba8dafbaa1 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:33.477650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd65a2-7f3b-4299-90a9-b8ba8dafbaa1 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:33.477953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd65a2-7f3b-4299-90a9-b8ba8dafbaa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:33.486012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd65a2-7f3b-4299-90a9-b8ba8dafbaa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:33.487565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd65a2-7f3b-4299-90a9-b8ba8dafbaa1 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:33.496965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 750/1482] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:36.011308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944bfb-763f-4518-a1fe-5683d3f607b6 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:36.011894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944bfb-763f-4518-a1fe-5683d3f607b6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:36.011894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b944bfb-763f-4518-a1fe-5683d3f607b6 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:36.013665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 733/1483] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:36.018840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755adf-c9be-472b-9778-184f64cde645 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:36.020087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755adf-c9be-472b-9778-184f64cde645 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:36.020087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06755adf-c9be-472b-9778-184f64cde645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:36.038642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-06755adf-c9be-472b-9778-184f64cde645 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:36.039815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-06755adf-c9be-472b-9778-184f64cde645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:36.047494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 751/1484] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:36.085220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944bfb-763f-4518-a1fe-5683d3f607b6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:36.095878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b944bfb-763f-4518-a1fe-5683d3f607b6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:36.099455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926c117-a597-456e-b0c3-49a78a0246b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:36.100118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c117-a597-456e-b0c3-49a78a0246b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:36.100410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c117-a597-456e-b0c3-49a78a0246b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:36.100690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926c117-a597-456e-b0c3-49a78a0246b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:36.109771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926c117-a597-456e-b0c3-49a78a0246b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:36.111199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926c117-a597-456e-b0c3-49a78a0246b1 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:36.121248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 734/1485] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:38.528005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2fb36-44a1-4f2d-a5bb-4e812277f61b None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:38.529127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2fb36-44a1-4f2d-a5bb-4e812277f61b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:38.529414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2fb36-44a1-4f2d-a5bb-4e812277f61b None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:38.531209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 752/1486] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:38.537672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8158cc-d4b2-46da-bab8-ccbe524b1f14 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:38.538148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8158cc-d4b2-46da-bab8-ccbe524b1f14 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:38.538278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8158cc-d4b2-46da-bab8-ccbe524b1f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:38.556937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6f8158cc-d4b2-46da-bab8-ccbe524b1f14 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:38.558132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6f8158cc-d4b2-46da-bab8-ccbe524b1f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:38.566679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 735/1487] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:38.605217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2fb36-44a1-4f2d-a5bb-4e812277f61b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:38.622048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2fb36-44a1-4f2d-a5bb-4e812277f61b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:38.627530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bcddb-6da2-42a9-b285-18c71cc1a48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:38.629224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcddb-6da2-42a9-b285-18c71cc1a48f service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:38.629595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcddb-6da2-42a9-b285-18c71cc1a48f service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:38.629954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bcddb-6da2-42a9-b285-18c71cc1a48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:38.639692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bcddb-6da2-42a9-b285-18c71cc1a48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:38.641168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bcddb-6da2-42a9-b285-18c71cc1a48f service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:38.651588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 753/1488] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:41.227244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd944-2aa8-4089-a6a8-70eeecbf673c None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:41.227908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd944-2aa8-4089-a6a8-70eeecbf673c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:41.227908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fd944-2aa8-4089-a6a8-70eeecbf673c None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:41.229676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 736/1489] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:41.236022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365c23-81bb-434c-b7b4-745dd22c5a23 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:41.236614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365c23-81bb-434c-b7b4-745dd22c5a23 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:41.236614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66365c23-81bb-434c-b7b4-745dd22c5a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:41.257791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-66365c23-81bb-434c-b7b4-745dd22c5a23 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:41.266214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-66365c23-81bb-434c-b7b4-745dd22c5a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:41.267245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 754/1490] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:41.310292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd944-2aa8-4089-a6a8-70eeecbf673c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:41.321636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fd944-2aa8-4089-a6a8-70eeecbf673c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:41.325364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75bf00-149b-42b6-8e96-b65c4d243d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:41.325995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75bf00-149b-42b6-8e96-b65c4d243d3f service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:41.326282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75bf00-149b-42b6-8e96-b65c4d243d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:41.326556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75bf00-149b-42b6-8e96-b65c4d243d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:41.336365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75bf00-149b-42b6-8e96-b65c4d243d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:41.337815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75bf00-149b-42b6-8e96-b65c4d243d3f service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:41.349289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 737/1491] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:03:44.078986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997007-a42f-4b9f-a96d-29441d68b78f None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:44.079566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997007-a42f-4b9f-a96d-29441d68b78f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:44.079566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f997007-a42f-4b9f-a96d-29441d68b78f None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:44.082479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 755/1492] 10.222.0.91 () {54 vars in 926 bytes} [Mon Feb 21 01:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:03:44.088987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e394-4b8f-4028-b609-66e286a978ac None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:44.089499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e394-4b8f-4028-b609-66e286a978ac None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:44.089618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289e394-4b8f-4028-b609-66e286a978ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:44.108617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a289e394-4b8f-4028-b609-66e286a978ac None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:03:44.109817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a289e394-4b8f-4028-b609-66e286a978ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:03:44.119447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 738/1493] 10.222.0.91 () {58 vars in 1023 bytes} [Mon Feb 21 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:03:44.162792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997007-a42f-4b9f-a96d-29441d68b78f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:03:44.174353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f997007-a42f-4b9f-a96d-29441d68b78f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:03:44.178873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42578f4a-f0fa-4cf1-8ea3-3c191ba542af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:03:44.179550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578f4a-f0fa-4cf1-8ea3-3c191ba542af service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:03:44.179864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578f4a-f0fa-4cf1-8ea3-3c191ba542af service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:03:44.180161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42578f4a-f0fa-4cf1-8ea3-3c191ba542af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:03:44.189769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578f4a-f0fa-4cf1-8ea3-3c191ba542af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:03:44.191302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42578f4a-f0fa-4cf1-8ea3-3c191ba542af service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:03:44.201199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 756/1494] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:05:22.896861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:22.897697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:22.897697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:22.917427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:05:22.918713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:05:22.927056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 739/1495] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:05:22.935733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:22.936335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:22.936335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:22.956260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:05:22.957501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:05:22.965982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 757/1496] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:05:22.971610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:22.981637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20764b-0be9-45d2-b8f5-a4c3bed88219 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:22.987392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:22.988248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:22.988639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:22.989022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:22.989907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:05:22.990327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:22.992107 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.006478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 740/1497] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:05:23.015790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:23.025509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21a17b-8e1d-48ea-9ac3-fc3d791da7ea None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:23.031408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:23.032127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.032419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.032701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.033462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:23.035493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.179254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 758/1498] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:05:23 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:05:23.183595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:23.194349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd58ac-efe3-4fe3-98d5-5a2ad3992a7f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:23.260548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:23.261786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.262294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.262650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.264006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:23.267636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.336859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 741/1499] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:05:23 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:05:23.343439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:23.362311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1635c-582b-442d-b4c0-e76acf9434e6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:23.370584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:23.371744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.372293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.372801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.374181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:23.377561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.400657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 759/1500] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:05:23.408072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:23.421505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c61d3-b6a2-458e-9221-ab236a42159d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:23.426847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379096-8241-4754-bb8f-157b7f3a04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:23.427548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379096-8241-4754-bb8f-157b7f3a04a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.427858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379096-8241-4754-bb8f-157b7f3a04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.428147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379096-8241-4754-bb8f-157b7f3a04a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.428898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379096-8241-4754-bb8f-157b7f3a04a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:23.430610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379096-8241-4754-bb8f-157b7f3a04a8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.445928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 742/1501] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:05:23.451079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:23.462373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44563a0-f5bd-4eea-9aa0-551b4323bdb6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:23.468690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:23.469596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.469881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.470161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] PATH_INFO: `/v3/projects/473615d227854ec4af6bc9250f5ee0a3/users/71d528d1ca904da28618c1e6168b1b69/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.488256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] RBAC: Authorizing `identity:create_grant(project_id=473615d227854ec4af6bc9250f5ee0a3, user_id=71d528d1ca904da28618c1e6168b1b69, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:23.490985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.577387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 760/1502] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:05:23 2022] PUT /identity/v3/projects/473615d227854ec4af6bc9250f5ee0a3/users/71d528d1ca904da28618c1e6168b1b69/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:05:23.598316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108dbb-7d62-4112-accd-f4ab557f19a5 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.598746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108dbb-7d62-4112-accd-f4ab557f19a5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.599039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16108dbb-7d62-4112-accd-f4ab557f19a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.629520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-16108dbb-7d62-4112-accd-f4ab557f19a5 None None] MFA Rules not processed for user `71d528d1ca904da28618c1e6168b1b69`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:05:23.630775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-16108dbb-7d62-4112-accd-f4ab557f19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:05:23.698435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 743/1503] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:05:23.710558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:23.805379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532f538-234f-4898-8dd4-93ab8256367d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:23.811674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:23.812487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.812881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.813261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.828329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:23.831484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:23.847745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 761/1504] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:05:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:05:23.922319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a49188-0232-4bdc-abe1-bdd1312440f3 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:23.922879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a49188-0232-4bdc-abe1-bdd1312440f3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:23.922879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a49188-0232-4bdc-abe1-bdd1312440f3 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:23.925012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 744/1505] 10.222.0.91 () {52 vars in 829 bytes} [Mon Feb 21 01:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:05:23.931592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:24.025583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d86a98-4cf7-4d5f-b5db-f2b519cf932c service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:24.030966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:24.031874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:24.032163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:24.032438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] PATH_INFO: `/v3/users/71d528d1ca904da28618c1e6168b1b69` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:24.033704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d528d1ca904da28618c1e6168b1b69)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:24.034723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:05:24.034723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 01:05:24.034723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 01:05:24.035954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:24.450095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d528d1ca904da28618c1e6168b1b69'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:24.451451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d528d1ca904da28618c1e6168b1b69'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:24.464874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d528d1ca904da28618c1e6168b1b69'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:24.485208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d528d1ca904da28618c1e6168b1b69'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:24.486029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d528d1ca904da28618c1e6168b1b69'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:24.566904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 762/1506] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:05:23 2022] DELETE /identity/v3/users/71d528d1ca904da28618c1e6168b1b69 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:05:24.572243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:24.572667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:24.573077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:24.593909 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:05:24.595156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:05:24.659740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 745/1507] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:05:24.669855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:24.671708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:05:24.739463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd3f62-7153-4243-b534-4c09ac3b32ea admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:24.743568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b793f-ccba-4492-a00b-38ae1405f31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:24.744367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b793f-ccba-4492-a00b-38ae1405f31b service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:24.744690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b793f-ccba-4492-a00b-38ae1405f31b service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:24.744970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b793f-ccba-4492-a00b-38ae1405f31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:24.755710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b793f-ccba-4492-a00b-38ae1405f31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:24.757266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b793f-ccba-4492-a00b-38ae1405f31b service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:24.769901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 763/1508] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:05:25.333564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:05:25.335159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:05:25.360770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58f5dd-3a5a-41ae-ab9a-7128dd475929 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:05:25.363692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:05:25.364439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:05:25.364981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:05:25.365542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] PATH_INFO: `/v3/projects/473615d227854ec4af6bc9250f5ee0a3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:05:25.367798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=473615d227854ec4af6bc9250f5ee0a3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:05:25.369791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:05:25.369791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 01:05:25.369791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 01:05:25.372412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:05:25.538560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473615d227854ec4af6bc9250f5ee0a3', 'request_id': 'req-60db880a-47d9-4161-afb7-7e9ef950d3cd'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:25.546529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473615d227854ec4af6bc9250f5ee0a3', 'request_id': 'req-60db880a-47d9-4161-afb7-7e9ef950d3cd'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:25.650556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473615d227854ec4af6bc9250f5ee0a3', 'request_id': 'req-60db880a-47d9-4161-afb7-7e9ef950d3cd'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:25.670530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] The token cache is being invalidate because project 473615d227854ec4af6bc9250f5ee0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:05:25.670821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:25.671697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-60db880a-47d9-4161-afb7-7e9ef950d3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:05:25.673254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 746/1509] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:05:25 2022] DELETE /identity/v3/projects/473615d227854ec4af6bc9250f5ee0a3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:07:04.279459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f6f2-297e-4b87-aac0-e9532b7c4068 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:04.280525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f6f2-297e-4b87-aac0-e9532b7c4068 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:04.280525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4f6f2-297e-4b87-aac0-e9532b7c4068 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:04.282915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 764/1510] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:07:04.287615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304de2-2e59-45cc-9b05-f9ed4715c611 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:04.288375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304de2-2e59-45cc-9b05-f9ed4715c611 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:04.288505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304de2-2e59-45cc-9b05-f9ed4715c611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:04.315863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-cb304de2-2e59-45cc-9b05-f9ed4715c611 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:04.318251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cb304de2-2e59-45cc-9b05-f9ed4715c611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:04.403131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 747/1511] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:07:04.463770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb66c9-c04b-429d-a32b-2c0cb9df2f84 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:04.464210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb66c9-c04b-429d-a32b-2c0cb9df2f84 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:04.464570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb66c9-c04b-429d-a32b-2c0cb9df2f84 None None] PATH_INFO: `/v3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:04.466255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 765/1512] 10.222.0.65 () {54 vars in 925 bytes} [Mon Feb 21 01:07:04 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:07:04.473665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb241-0f75-43d1-907e-e34558216e0f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:04.474078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb241-0f75-43d1-907e-e34558216e0f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:04.474434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb241-0f75-43d1-907e-e34558216e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:04.495686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-022bb241-0f75-43d1-907e-e34558216e0f None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:04.497079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-022bb241-0f75-43d1-907e-e34558216e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:04.565875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 748/1513] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Feb 21 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:07:04.639320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb66c9-c04b-429d-a32b-2c0cb9df2f84 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:04.641622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-76cb66c9-c04b-429d-a32b-2c0cb9df2f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:04.746202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb66c9-c04b-429d-a32b-2c0cb9df2f84 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:04.752850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b0e7b-071c-44dd-9b53-0a957f63ce99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:04.753633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b0e7b-071c-44dd-9b53-0a957f63ce99 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:04.753945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b0e7b-071c-44dd-9b53-0a957f63ce99 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:04.754291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b0e7b-071c-44dd-9b53-0a957f63ce99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:04.765478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b0e7b-071c-44dd-9b53-0a957f63ce99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:04.767435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b0e7b-071c-44dd-9b53-0a957f63ce99 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:04.780845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 766/1514] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:07:06.147782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667386-c925-478c-936c-1c5f8057141d None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:06.148455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667386-c925-478c-936c-1c5f8057141d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:06.148620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46667386-c925-478c-936c-1c5f8057141d None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:06.151104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 749/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:07:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:06.156966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb438-1460-4960-8f01-2d2766483d4a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:06.157544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb438-1460-4960-8f01-2d2766483d4a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:06.157685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb438-1460-4960-8f01-2d2766483d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:06.178948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-385eb438-1460-4960-8f01-2d2766483d4a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:06.180258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-385eb438-1460-4960-8f01-2d2766483d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:06.189310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 767/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:07:06.346653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667386-c925-478c-936c-1c5f8057141d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:06.362725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46667386-c925-478c-936c-1c5f8057141d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:06.368515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2be1-d0c6-406c-9e45-0dce14613aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:06.369165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2be1-d0c6-406c-9e45-0dce14613aa9 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:06.369449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2be1-d0c6-406c-9e45-0dce14613aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:06.369732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2be1-d0c6-406c-9e45-0dce14613aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:06.379110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2be1-d0c6-406c-9e45-0dce14613aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:06.380820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2be1-d0c6-406c-9e45-0dce14613aa9 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:06.393070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 750/1517] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:07:08.855470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc326-dfb3-4377-8966-1991a3c703ac None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:08.856156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc326-dfb3-4377-8966-1991a3c703ac None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:08.856156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcc326-dfb3-4377-8966-1991a3c703ac None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:08.857948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 768/1518] 10.222.0.91 () {54 vars in 960 bytes} [Mon Feb 21 01:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:08.864362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564b7a-da17-452a-9602-d81f1444a02c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:08.865078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564b7a-da17-452a-9602-d81f1444a02c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:08.865564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564b7a-da17-452a-9602-d81f1444a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:08.888276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-56564b7a-da17-452a-9602-d81f1444a02c None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:08.889529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-56564b7a-da17-452a-9602-d81f1444a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:08.898502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 751/1519] 10.222.0.91 () {58 vars in 1057 bytes} [Mon Feb 21 01:07:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:07:08.907219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc326-dfb3-4377-8966-1991a3c703ac None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:08.921718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcc326-dfb3-4377-8966-1991a3c703ac None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:08.927693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fad438-16e3-4459-bdd2-1faebbb99c6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:08.928957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fad438-16e3-4459-bdd2-1faebbb99c6f service placement] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:08.929244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fad438-16e3-4459-bdd2-1faebbb99c6f service placement] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:08.929523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fad438-16e3-4459-bdd2-1faebbb99c6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:08.939076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fad438-16e3-4459-bdd2-1faebbb99c6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:08.942765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fad438-16e3-4459-bdd2-1faebbb99c6f service placement] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:08.951823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 769/1520] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:07:18.296924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7173af-90e4-4e9c-9837-a3dcadbfa92a None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:18.297544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7173af-90e4-4e9c-9837-a3dcadbfa92a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:18.297665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7173af-90e4-4e9c-9837-a3dcadbfa92a None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:18.300296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 752/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:07:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:18.307905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fecb2-498e-45a0-bb08-464e5c904a74 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:18.308573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fecb2-498e-45a0-bb08-464e5c904a74 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:18.308954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fecb2-498e-45a0-bb08-464e5c904a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:18.337377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-4e7fecb2-498e-45a0-bb08-464e5c904a74 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:18.340484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4e7fecb2-498e-45a0-bb08-464e5c904a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:18.356655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 770/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:07:18.533636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7173af-90e4-4e9c-9837-a3dcadbfa92a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:18.551046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7173af-90e4-4e9c-9837-a3dcadbfa92a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:18.559003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c48b66-12a2-420b-bb0c-3268d06fa453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:18.559665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b66-12a2-420b-bb0c-3268d06fa453 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:18.559986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b66-12a2-420b-bb0c-3268d06fa453 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:18.560269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c48b66-12a2-420b-bb0c-3268d06fa453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:18.570090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48b66-12a2-420b-bb0c-3268d06fa453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:18.571869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c48b66-12a2-420b-bb0c-3268d06fa453 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:18.585649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 753/1523] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:07:20.013462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58ed3-01ba-4fd1-8ccb-a511562b309a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:20.014243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58ed3-01ba-4fd1-8ccb-a511562b309a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:20.014243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d58ed3-01ba-4fd1-8ccb-a511562b309a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:20.016378 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 771/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 01:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:07:20.022269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8154-5ad6-4057-9a07-b4efd27928cd None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:20.023056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8154-5ad6-4057-9a07-b4efd27928cd None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:20.023056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f8154-5ad6-4057-9a07-b4efd27928cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:20.048354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-637f8154-5ad6-4057-9a07-b4efd27928cd None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:20.049577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-637f8154-5ad6-4057-9a07-b4efd27928cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:20.058358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 754/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 01:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:07:20.223059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58ed3-01ba-4fd1-8ccb-a511562b309a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:20.239558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d58ed3-01ba-4fd1-8ccb-a511562b309a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:20.246121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac91a7-9be2-4408-bf4f-5d1d2ea589d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:20.246785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac91a7-9be2-4408-bf4f-5d1d2ea589d6 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:20.247079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac91a7-9be2-4408-bf4f-5d1d2ea589d6 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:20.247359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac91a7-9be2-4408-bf4f-5d1d2ea589d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:20.257366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac91a7-9be2-4408-bf4f-5d1d2ea589d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:20.260464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac91a7-9be2-4408-bf4f-5d1d2ea589d6 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:20.279082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 772/1526] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:07:24.809205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9dd6-d758-4fcf-bc9a-784e375871cd None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:24.810288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9dd6-d758-4fcf-bc9a-784e375871cd None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:24.810288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b9dd6-d758-4fcf-bc9a-784e375871cd None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:24.811548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 755/1527] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:07:24.817410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c183-2fcf-48cf-bcd8-32f0be5f1a2a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:24.817962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c183-2fcf-48cf-bcd8-32f0be5f1a2a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:24.817962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8c183-2fcf-48cf-bcd8-32f0be5f1a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:24.838372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d4f8c183-2fcf-48cf-bcd8-32f0be5f1a2a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:24.839600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d4f8c183-2fcf-48cf-bcd8-32f0be5f1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:24.848094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 773/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:07:24.891347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9dd6-d758-4fcf-bc9a-784e375871cd None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:24.893353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2a6b9dd6-d758-4fcf-bc9a-784e375871cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:24.959414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b9dd6-d758-4fcf-bc9a-784e375871cd None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:24.965839 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f39e8-26e5-4c11-82fe-0ff723dc68e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:24.967178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f39e8-26e5-4c11-82fe-0ff723dc68e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:24.967821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f39e8-26e5-4c11-82fe-0ff723dc68e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:24.968574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f39e8-26e5-4c11-82fe-0ff723dc68e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:24.987660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f39e8-26e5-4c11-82fe-0ff723dc68e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:24.991534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f39e8-26e5-4c11-82fe-0ff723dc68e1 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:25.011688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 756/1529] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:07:27.552191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6e3c8-bb79-409b-8864-2cc2cdd65c14 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:27.552816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6e3c8-bb79-409b-8864-2cc2cdd65c14 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:27.552816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6e3c8-bb79-409b-8864-2cc2cdd65c14 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:27.554568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 774/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:27.561332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5810b0-977c-4178-a009-7ba5eeb7d280 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:27.561930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5810b0-977c-4178-a009-7ba5eeb7d280 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:27.561930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5810b0-977c-4178-a009-7ba5eeb7d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:27.589435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-de5810b0-977c-4178-a009-7ba5eeb7d280 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:27.590897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-de5810b0-977c-4178-a009-7ba5eeb7d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:27.599290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 757/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:07:27.638315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6e3c8-bb79-409b-8864-2cc2cdd65c14 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:27.650125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6e3c8-bb79-409b-8864-2cc2cdd65c14 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:27.654121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc22f78-c571-4cab-b338-7bedbcfed8b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:27.654847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc22f78-c571-4cab-b338-7bedbcfed8b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:27.655248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc22f78-c571-4cab-b338-7bedbcfed8b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:27.655565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc22f78-c571-4cab-b338-7bedbcfed8b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:27.666918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc22f78-c571-4cab-b338-7bedbcfed8b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:27.668742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc22f78-c571-4cab-b338-7bedbcfed8b6 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:27.679821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 775/1532] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:07:31.926515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830f901-8683-4a31-97b4-6097efb9b2e0 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:31.927201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830f901-8683-4a31-97b4-6097efb9b2e0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:31.927201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830f901-8683-4a31-97b4-6097efb9b2e0 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:31.929633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 758/1533] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:07:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:31.936750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f862c-a803-46e6-a568-5103399e5210 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:31.937611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f862c-a803-46e6-a568-5103399e5210 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:31.937611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f862c-a803-46e6-a568-5103399e5210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:31.961062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9a6f862c-a803-46e6-a568-5103399e5210 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:31.962645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9a6f862c-a803-46e6-a568-5103399e5210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:31.970916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 776/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:07:32.245306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830f901-8683-4a31-97b4-6097efb9b2e0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:32.247711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0830f901-8683-4a31-97b4-6097efb9b2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:32.322694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830f901-8683-4a31-97b4-6097efb9b2e0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:32.326738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5ebe-4077-40f0-bac6-1f0a239180d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:32.327439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5ebe-4077-40f0-bac6-1f0a239180d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:32.327752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5ebe-4077-40f0-bac6-1f0a239180d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:32.328092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5ebe-4077-40f0-bac6-1f0a239180d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:32.339620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5ebe-4077-40f0-bac6-1f0a239180d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:32.341240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5ebe-4077-40f0-bac6-1f0a239180d1 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:32.352427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 759/1535] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:07:34.844913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4573d4-bd93-4401-925f-3b8ef087c9af None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:34.845680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4573d4-bd93-4401-925f-3b8ef087c9af None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:34.845680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4573d4-bd93-4401-925f-3b8ef087c9af None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:34.847267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 777/1536] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 01:07:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:34.856518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d3d1-972f-49a1-bedf-03189079d724 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:34.857104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d3d1-972f-49a1-bedf-03189079d724 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:34.857450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9d3d1-972f-49a1-bedf-03189079d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:34.886085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-dae9d3d1-972f-49a1-bedf-03189079d724 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:34.888211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dae9d3d1-972f-49a1-bedf-03189079d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:34.898689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 760/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 01:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:07:35.168719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74090e2-c37a-4bb2-8476-117f43a11945 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:35.168908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74090e2-c37a-4bb2-8476-117f43a11945 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:35.169182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74090e2-c37a-4bb2-8476-117f43a11945 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:35.170961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 778/1538] 10.222.0.91 () {54 vars in 963 bytes} [Mon Feb 21 01:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:07:35.175932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8671c9-9ffb-453f-9def-cb045149fa24 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:35.176305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8671c9-9ffb-453f-9def-cb045149fa24 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:35.176645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8671c9-9ffb-453f-9def-cb045149fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:35.195490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-cb8671c9-9ffb-453f-9def-cb045149fa24 None None] MFA Rules not processed for user `7c90c0c26a544e089b126df43151e6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:07:35.197259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cb8671c9-9ffb-453f-9def-cb045149fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:07:35.203688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 761/1539] 10.222.0.91 () {58 vars in 1060 bytes} [Mon Feb 21 01:07:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:07:35.211629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74090e2-c37a-4bb2-8476-117f43a11945 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:07:35.223516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74090e2-c37a-4bb2-8476-117f43a11945 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:07:35.227135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31caf2-0fde-4f5e-8e0d-58c8ac71612d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:07:35.228369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31caf2-0fde-4f5e-8e0d-58c8ac71612d service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:07:35.228662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31caf2-0fde-4f5e-8e0d-58c8ac71612d service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:07:35.228948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31caf2-0fde-4f5e-8e0d-58c8ac71612d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:07:35.238283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31caf2-0fde-4f5e-8e0d-58c8ac71612d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:07:35.239803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31caf2-0fde-4f5e-8e0d-58c8ac71612d service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:07:35.250160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 779/1540] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:01.523630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.524320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.524320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.556884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.558116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:01.569809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 762/1541] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:01.579172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.580157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.580632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.609123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.610246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:01.622826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 780/1542] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:01.627583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:01.641686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e6a40-50b4-452b-a2fe-a0ad71c3f69c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:01.652410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:01.653551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.653551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.653750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.654360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:01.654669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:01.656331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef4711-a74f-46d9-8f21-f7e9a0de6d00 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:01.675409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 763/1543] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:09:01.684643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:01.694964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cbcf4-d8ee-45dc-bb6b-5aecec50f7dc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:01.704783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977baab0-8f13-43c9-ab39-83c7ea739c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:01.705456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977baab0-8f13-43c9-ab39-83c7ea739c1e admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.705749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977baab0-8f13-43c9-ab39-83c7ea739c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.706015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977baab0-8f13-43c9-ab39-83c7ea739c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.706725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977baab0-8f13-43c9-ab39-83c7ea739c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:01.708677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977baab0-8f13-43c9-ab39-83c7ea739c1e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:01.720785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4494a-a7da-4ad8-a216-d27941701383 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.721147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4494a-a7da-4ad8-a216-d27941701383 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.721362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4494a-a7da-4ad8-a216-d27941701383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.755700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d1b4494a-a7da-4ad8-a216-d27941701383 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.757014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d1b4494a-a7da-4ad8-a216-d27941701383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:01.772660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 764/1544] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:01.774078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272200b2-cc90-4c47-9447-a9c95ce693bb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.774639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272200b2-cc90-4c47-9447-a9c95ce693bb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.774926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272200b2-cc90-4c47-9447-a9c95ce693bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.805443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-272200b2-cc90-4c47-9447-a9c95ce693bb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.806933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-272200b2-cc90-4c47-9447-a9c95ce693bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:01.822285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 765/1545] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:01.823806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.824188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.824460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.838129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 781/1546] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/projects => generated 391 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:01.839523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2231bae-5a39-4670-86d7-9960192d307a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.839880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2231bae-5a39-4670-86d7-9960192d307a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.840166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2231bae-5a39-4670-86d7-9960192d307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.875847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.876961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:01.888891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c2231bae-5a39-4670-86d7-9960192d307a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.890091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c2231bae-5a39-4670-86d7-9960192d307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:01.968289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 766/1547] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:01.969205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:01.975731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 782/1548] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:01.977474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf57af7-42e9-4cca-abb0-c99417acd48c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.978007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf57af7-42e9-4cca-abb0-c99417acd48c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.978512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf57af7-42e9-4cca-abb0-c99417acd48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.979782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0600-612e-45df-b25a-a22a0008656c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:01.984623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880991c-7981-4570-bb25-db907aa04629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:01.985347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880991c-7981-4570-bb25-db907aa04629 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:01.985687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880991c-7981-4570-bb25-db907aa04629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:01.985983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880991c-7981-4570-bb25-db907aa04629 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:01.986675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880991c-7981-4570-bb25-db907aa04629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:01.988626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880991c-7981-4570-bb25-db907aa04629 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:01.997085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-abf57af7-42e9-4cca-abb0-c99417acd48c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:01.998280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-abf57af7-42e9-4cca-abb0-c99417acd48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.007398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 783/1549] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.012093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af907778-d1fb-4995-9d3d-1ea5c1a37979 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.012093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af907778-d1fb-4995-9d3d-1ea5c1a37979 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.012093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af907778-d1fb-4995-9d3d-1ea5c1a37979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.029144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-af907778-d1fb-4995-9d3d-1ea5c1a37979 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.030346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-af907778-d1fb-4995-9d3d-1ea5c1a37979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.039409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 784/1550] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.040835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.040995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.041255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.060078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.061147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.066833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 767/1551] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:01 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.068270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.068563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.069012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.071412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 785/1552] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.071412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.081055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9fcf4-10b3-423d-9023-3f787c3f0222 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.086636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.087301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.087586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.087896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.088366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.088632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.088949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.089558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.090546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c7bfd-5f36-49e6-9da3-9c6bc9176ef3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.097474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 768/1553] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.098401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.103889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 786/1554] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.105618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669e98c-070c-46e8-bf01-5a56d7629d69 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.106291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669e98c-070c-46e8-bf01-5a56d7629d69 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.106579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669e98c-070c-46e8-bf01-5a56d7629d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.115082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b640d-11d7-49be-8e56-978244608957 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.120739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.123305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.123305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.123305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.123305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.123305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.125097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e669e98c-070c-46e8-bf01-5a56d7629d69 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.125232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2afbc7-83ba-46ee-8755-8a66382c748d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.126333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e669e98c-070c-46e8-bf01-5a56d7629d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.134804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 787/1555] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.135879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.136171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.136445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.144592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 769/1556] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.144592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b257245-36d4-4b94-a766-08664270d595 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.144592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b257245-36d4-4b94-a766-08664270d595 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.144592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b257245-36d4-4b94-a766-08664270d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.161464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.162531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3b257245-36d4-4b94-a766-08664270d595 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.163575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.164750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3b257245-36d4-4b94-a766-08664270d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.171979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 788/1557] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.172619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 770/1558] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.173854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90349b-6ca5-445b-8a5d-2eb16d0bb43f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.174147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90349b-6ca5-445b-8a5d-2eb16d0bb43f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.174415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90349b-6ca5-445b-8a5d-2eb16d0bb43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.177042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.188140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407de6e-2197-49be-8827-c6c24997e53a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.192666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-da90349b-6ca5-445b-8a5d-2eb16d0bb43f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.193314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.193872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-da90349b-6ca5-445b-8a5d-2eb16d0bb43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.194031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.194317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.194597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.195329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.196990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.202135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 771/1559] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.204060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.204060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.204060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.209190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 789/1560] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:02.210878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.222559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20340e8f-7820-4111-9fb6-7f203658a66b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.225947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.227130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.228216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.228885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.229167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.229446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.230145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.232114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.234955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 772/1561] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.235756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.246349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe3f5-6705-42bf-8799-bfcf2b6d7958 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.252617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.252617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.252617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.252970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.253559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.253871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.255515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.268745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 773/1562] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.269577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.282318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff106f-274c-4a02-a331-31893d35f074 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.287253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72678eb3-4987-4b41-8b57-794b557bd003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.289304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72678eb3-4987-4b41-8b57-794b557bd003 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.289833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72678eb3-4987-4b41-8b57-794b557bd003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.290359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72678eb3-4987-4b41-8b57-794b557bd003 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.291269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72678eb3-4987-4b41-8b57-794b557bd003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.293234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72678eb3-4987-4b41-8b57-794b557bd003 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.392976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 790/1563] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/projects => generated 403 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.392976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.423158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 774/1564] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.424533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.424893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.425160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.442893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:02.444113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:02.454454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9139-283a-4530-b39a-6160860f5b4d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.504602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 775/1565] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:02.505493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.515260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3f7c2-e93e-4492-b1ec-a70c1e02c5c6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.516015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.516673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.516959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.517232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.518000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.518259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.519893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.520045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.520705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.520992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.521273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.522579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.522937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.524594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.536377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 776/1566] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.537249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.542755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 791/1567] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.543536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.548851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e4a26-8436-4f69-b554-075bfcb10f57 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.553769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935af8a-8881-46e7-8722-ef8efb42ab14 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.553995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.554769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.555055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.555334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.556130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.557772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.558628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.559277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.559558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.559851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.560620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.560923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.562639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.569161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 777/1568] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:02.574304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.576699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 792/1569] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.577560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.580714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0f043-0516-49e2-98c3-dcd268bc0e0b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.588112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461d8a-8778-4cc3-b410-4cad25baba29 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.592179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.592854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.593144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.593426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.594128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.594688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.595352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.595633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.596038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.596164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.596621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.598530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.690459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 793/1570] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.691306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.701674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540ed19-b1f0-468b-a61c-3abd5aa0a095 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.707213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 778/1571] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.707213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.707472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.707472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.707472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.707472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.708163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.710837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.768558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7762a-349e-4391-a4de-5dad7e0c3374 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.774555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.775245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.775529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.775807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.776566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:02.776871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.778459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.790690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 779/1572] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:02.791793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.800804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4411-d940-4b77-8dff-784c3ad73483 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.806204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.806845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.807131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.807409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.808123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.810172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.816270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 794/1573] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.817115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.828088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae60ba-b340-41d8-b3bd-499a72ca31cb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:02.832819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:02.833470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:02.833757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:02.834039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:02.835638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:02.837619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:02.912259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 780/1574] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.913403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.944642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 795/1575] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/projects => generated 357 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:02.944642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:02.976759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39e10b-38e8-4f86-a174-ac19e0ce99c4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.005689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dfeae-8842-495b-8d74-c5b65d9700d6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.011455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.012140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.012433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.012716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.013505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.015326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.032638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.033524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.033807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.034088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] PATH_INFO: `/v3/projects/a5cb0164f98741baba94fcc1b7709e7e/users/8287f43e83034c0a80ee051456d502c6/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.048957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cb0164f98741baba94fcc1b7709e7e, user_id=8287f43e83034c0a80ee051456d502c6, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.051675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.102983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 796/1576] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:02 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.103818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.130336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 781/1577] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:02 2022] PUT /identity/v3/projects/a5cb0164f98741baba94fcc1b7709e7e/users/8287f43e83034c0a80ee051456d502c6/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:03.131324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.168564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1533ba7-0fa7-4ab6-a5af-70b2f1ba7057 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.193433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f870ff0-146c-4512-9448-ba5fd6803919 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.199560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.200192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.200476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.200797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.201559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.203459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.224841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.225995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.226418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.226809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.227654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.229543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.239878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 797/1578] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.241223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.251257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27987b04-b360-405e-8c7e-2d3ddabdfc11 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.255898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.257172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.257612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.257896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.258584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.260504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.318029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 782/1579] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.318698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.329685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e497cf-d75a-4b40-ba7d-f202dfcac162 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.334356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.335682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.336007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.336299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.337027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.338747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.347596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 798/1580] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.348466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.349149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 783/1581] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.349941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.361167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068badda-9b6d-478e-a218-cf7ec8d1639b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.423250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.423963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.424249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.424527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.424708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea420ad9-58d6-4837-8913-081b88f880b9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.425222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.427147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.430684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0913350-aabf-415f-9ca7-45bef0dcdb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.431353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0913350-aabf-415f-9ca7-45bef0dcdb0b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.431640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0913350-aabf-415f-9ca7-45bef0dcdb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.431956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0913350-aabf-415f-9ca7-45bef0dcdb0b admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.432688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0913350-aabf-415f-9ca7-45bef0dcdb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.434651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0913350-aabf-415f-9ca7-45bef0dcdb0b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.528506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 784/1582] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/users => generated 279 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.529381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.540316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fac796-5d35-465b-97f5-7fbac86f3c60 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.545016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.545670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.545952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.546226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.546908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.548831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.559530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 799/1583] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.561193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.561489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.563881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.579912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:03.581147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:03.588758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 800/1584] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:03.589526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.598916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ba11c-d926-4e88-94ab-b6f0c3e5fcd5 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.604378 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.605029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.605317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.605598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.606328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.607982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.618902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 801/1585] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.619772 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.629800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c644a-5822-48ee-8209-2df9a7e39b8e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.634935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.635596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.636629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.636629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.636917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.638472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.638634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 785/1586] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.639443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.652598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 802/1587] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.652806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad148-2326-4241-9c15-3ea44fc28f39 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.652911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.655347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.656042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.656348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.656617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.657313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.659297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.660754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720d45-8913-453e-afad-91e9126848c2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.667523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.668234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.668529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.668818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.669549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.671159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.683964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 803/1588] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.684829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.696828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfca2b3-c28c-40d2-b6f0-0293a96f27a7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.702020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.705377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.705377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.705377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.705377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.705803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.717327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 804/1589] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.718190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.728964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9483-cd88-426c-b24e-1060eb260ae9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.733675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.734390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.734676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.734961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.735690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.737329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.748162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 805/1590] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.749023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.770819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 786/1591] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:03 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:03.771672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.782440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfce4fa-1e2d-4e03-8747-3d395a65a875 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.787257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.789135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.789422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.789704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] PATH_INFO: `/v3/projects/ee124c48dce94fb99528d9a0e30d3a84/users/968ea024466f4ffdb16d7b96dbce44a0/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.806389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee124c48dce94fb99528d9a0e30d3a84, user_id=968ea024466f4ffdb16d7b96dbce44a0, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.809114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.810340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cf05-2660-4656-b331-a54f3d0662d1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.814147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.814798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.815090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.815369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.826021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.827464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.837974 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 806/1592] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:03.838791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.847913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63e406-297c-4c5d-bc61-8c86d19cada0 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.853092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.853747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.854029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.854308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.855037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.856691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.867433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 807/1593] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.868273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.877858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51143ce5-4c5e-4c01-ac6f-f67614f0e53a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.883531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.884388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.884678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.884962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.885691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.887303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:03.900110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 808/1594] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:03.900110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.906062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 787/1595] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:03 2022] PUT /identity/v3/projects/ee124c48dce94fb99528d9a0e30d3a84/users/968ea024466f4ffdb16d7b96dbce44a0/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:03.918949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:03.922413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cd1b-c37f-479a-8840-8b6ec9772c31 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.983517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90666052-455d-4db7-8158-309ceee786bd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:03.985197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.986352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.986643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.986927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] PATH_INFO: `/v3/projects/b599acdadf39479e8590919e6d61e938/users/18cdae0c50d54b7e9e91fe46b965013d/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.988803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:03.989489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:03.989788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:03.990130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:03.990822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:03.992858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.003387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 788/1596] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:04.005349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b599acdadf39479e8590919e6d61e938, user_id=18cdae0c50d54b7e9e91fe46b965013d, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.007014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.009486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.021432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a3b63-ea10-461d-9df0-885841fd1ccb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.027048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.027730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.029669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.029669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.029669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.030639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.041777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 789/1597] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:04.042671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.052675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03457012-828f-4682-9b25-f00cd97b2434 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.057414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.058349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.058349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.058601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.059316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.060902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.072139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 790/1598] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:04.073059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.082545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02ecff-b7ce-4ec6-9529-d2e129b8dd52 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.084973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 809/1599] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:03 2022] PUT /identity/v3/projects/b599acdadf39479e8590919e6d61e938/users/18cdae0c50d54b7e9e91fe46b965013d/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:04.088019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.144333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552e4ab-3d39-43d9-98ea-970192a4bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.145029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e4ab-3d39-43d9-98ea-970192a4bc3d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.145313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e4ab-3d39-43d9-98ea-970192a4bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.145587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552e4ab-3d39-43d9-98ea-970192a4bc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.146304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552e4ab-3d39-43d9-98ea-970192a4bc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.148469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552e4ab-3d39-43d9-98ea-970192a4bc3d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.158932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 791/1600] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:04.159515 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d299c-7316-498b-b1d3-96254dbbd5ac admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.163539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.163858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.164156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.166566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.167460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.167742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.178728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] PATH_INFO: `/v3/projects/784d5ee9775c49d6a4127a0bea10323c/users/94dda2419e2242cc8102a08ad4c8c0b4/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.187106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784d5ee9775c49d6a4127a0bea10323c, user_id=94dda2419e2242cc8102a08ad4c8c0b4, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.192263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.201238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] MFA Rules not processed for user `968ea024466f4ffdb16d7b96dbce44a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:04.202690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:04.277242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 792/1601] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:04.278327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.289592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 810/1602] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:04 2022] PUT /identity/v3/projects/784d5ee9775c49d6a4127a0bea10323c/users/94dda2419e2242cc8102a08ad4c8c0b4/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:04.290054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eab439-8e2d-4c83-9d94-135b13879b74 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.290412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.353352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633006c-7c67-422d-8a4a-0569af488e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.354568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633006c-7c67-422d-8a4a-0569af488e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.355005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633006c-7c67-422d-8a4a-0569af488e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.355427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633006c-7c67-422d-8a4a-0569af488e65 admin admin] PATH_INFO: `/v3/projects/e5a7e30aa1db4b17bbf5314f6271a74c/users/29ad859990864e74b410a0a844bf2c90/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.363693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775060bf-31f7-42a8-bf22-57090f76f146 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.370105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.371287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.371892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.372272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] PATH_INFO: `/v3/projects/24c1bf236b2f4eb1bffab124b7392ca5/users/70516383f3b14d5283462803cac26d8b/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.373973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633006c-7c67-422d-8a4a-0569af488e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a7e30aa1db4b17bbf5314f6271a74c, user_id=29ad859990864e74b410a0a844bf2c90, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.376669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633006c-7c67-422d-8a4a-0569af488e65 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.389734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c1bf236b2f4eb1bffab124b7392ca5, user_id=70516383f3b14d5283462803cac26d8b, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.392639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.525249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 811/1603] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:04 2022] PUT /identity/v3/projects/24c1bf236b2f4eb1bffab124b7392ca5/users/70516383f3b14d5283462803cac26d8b/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:04.530067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.530201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 793/1604] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:04 2022] PUT /identity/v3/projects/e5a7e30aa1db4b17bbf5314f6271a74c/users/29ad859990864e74b410a0a844bf2c90/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:04.530201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da020-de7d-4805-868e-8a481414160a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.530737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da020-de7d-4805-868e-8a481414160a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.530922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da020-de7d-4805-868e-8a481414160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.570735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-fb1da020-de7d-4805-868e-8a481414160a None None] MFA Rules not processed for user `18cdae0c50d54b7e9e91fe46b965013d`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:04.572823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fb1da020-de7d-4805-868e-8a481414160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:04.594490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a69283-c191-4a59-808f-14284baa346a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.655961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 794/1605] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:04.657386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da020-de7d-4805-868e-8a481414160a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.672469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.672975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.673382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.673528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.674467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.676558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.688983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 812/1606] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:04.690193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.701791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e957bb-4a48-418a-b004-51f47bbb82a7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.707054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c27bc9-6b6f-4853-b909-364d0d1e1bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.707721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c27bc9-6b6f-4853-b909-364d0d1e1bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.708967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c27bc9-6b6f-4853-b909-364d0d1e1bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.708967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c27bc9-6b6f-4853-b909-364d0d1e1bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.709303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c27bc9-6b6f-4853-b909-364d0d1e1bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.712050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c27bc9-6b6f-4853-b909-364d0d1e1bd6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.750975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da020-de7d-4805-868e-8a481414160a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.755999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a17cb-5092-4c42-807a-f9d52bc3036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.757533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a17cb-5092-4c42-807a-f9d52bc3036f admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.757816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a17cb-5092-4c42-807a-f9d52bc3036f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.758095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a17cb-5092-4c42-807a-f9d52bc3036f admin admin] PATH_INFO: `/v3/projects/6cf6cd6009e64579b709348a6d883698/users/7606ed2906ed4a04b7ec43a37a1d7fc0/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.773558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a17cb-5092-4c42-807a-f9d52bc3036f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf6cd6009e64579b709348a6d883698, user_id=7606ed2906ed4a04b7ec43a37a1d7fc0, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.776249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a17cb-5092-4c42-807a-f9d52bc3036f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:04.828478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 813/1607] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/projects => generated 405 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:04.829779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7634a7-81da-45ee-b5e9-7f8e64e80109 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.830066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7634a7-81da-45ee-b5e9-7f8e64e80109 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.830343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7634a7-81da-45ee-b5e9-7f8e64e80109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.847856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9a7634a7-81da-45ee-b5e9-7f8e64e80109 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:04.849120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9a7634a7-81da-45ee-b5e9-7f8e64e80109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:04.868403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 795/1608] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:04 2022] PUT /identity/v3/projects/6cf6cd6009e64579b709348a6d883698/users/7606ed2906ed4a04b7ec43a37a1d7fc0/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:04.870413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dd122-e12e-4757-a652-8da963c845fb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.870413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dd122-e12e-4757-a652-8da963c845fb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.870413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654dd122-e12e-4757-a652-8da963c845fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.891792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-654dd122-e12e-4757-a652-8da963c845fb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:04.893041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-654dd122-e12e-4757-a652-8da963c845fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:04.940699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 814/1609] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:04.940699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.941815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.941989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.956464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 796/1610] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:04.957550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dd122-e12e-4757-a652-8da963c845fb None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:04.971714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654dd122-e12e-4757-a652-8da963c845fb None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:04.981335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:04.982023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:04.982308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:04.982763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:04.983394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:04.983680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] MFA Rules not processed for user `29ad859990864e74b410a0a844bf2c90`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:04.984910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:04.985569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.054891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 815/1611] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:05.055743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.067679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80affb-6beb-41f4-97f0-6cce9fc54839 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.072993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1738d-cae8-4b94-a0e7-3576c73039c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.073886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1738d-cae8-4b94-a0e7-3576c73039c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.074173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1738d-cae8-4b94-a0e7-3576c73039c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.074454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1738d-cae8-4b94-a0e7-3576c73039c3 admin admin] PATH_INFO: `/v3/projects/c4d5bc43b26f4e53987f61680e58e4d0/users/088087774f514bc6a4d2f8c28fecee2f/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.085975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 797/1612] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:04 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:05.086973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.094799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1738d-cae8-4b94-a0e7-3576c73039c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d5bc43b26f4e53987f61680e58e4d0, user_id=088087774f514bc6a4d2f8c28fecee2f, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.101993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1738d-cae8-4b94-a0e7-3576c73039c3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.163497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651cd1-68b7-4a18-b27c-39a7a76fe971 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.168450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.169146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.169425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.169699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.170387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.172334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.193066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 816/1613] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:05 2022] PUT /identity/v3/projects/c4d5bc43b26f4e53987f61680e58e4d0/users/088087774f514bc6a4d2f8c28fecee2f/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:05.198132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.198132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.198132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.230281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] MFA Rules not processed for user `7606ed2906ed4a04b7ec43a37a1d7fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:05.231712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:05.285403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 798/1614] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:05 2022] POST /identity/v3/users => generated 309 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:05.286646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.293537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:05.312084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 817/1615] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:05.312084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.315643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:05.375360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ea64-4195-4b3c-a5be-78192b50eb2b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.391581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d740-e4b6-4665-a386-e6e0d1a220b1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.395613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.396355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.401411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.401411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.438092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.441109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.441109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.441109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.483864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.485370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.497262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 818/1616] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:05.498149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.511023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271578d-3e19-494c-91f4-507bc753013c service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.515868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cc7ee-a5ae-4385-93ea-70af58c1809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.516699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cc7ee-a5ae-4385-93ea-70af58c1809b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.517489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cc7ee-a5ae-4385-93ea-70af58c1809b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.517489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cc7ee-a5ae-4385-93ea-70af58c1809b admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.517952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cc7ee-a5ae-4385-93ea-70af58c1809b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.519934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cc7ee-a5ae-4385-93ea-70af58c1809b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.520115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.521654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.532157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 799/1617] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:05.533155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.543478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63accae6-7143-4d49-a06b-ed99b10414f1 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.548599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.549888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.549888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.549888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.550599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.552579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.604835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 819/1618] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:05 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:05.606102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.606393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.606673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.634818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] MFA Rules not processed for user `088087774f514bc6a4d2f8c28fecee2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:05.636141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:05.674098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 800/1619] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:05 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:05.683795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.686745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84cab7-9239-4ef0-9e4b-a809e48414f8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.708852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 820/1620] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:05.712632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.763624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.764650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.765183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.765443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.766186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.768196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.774595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15522f-fed3-476c-877f-4fc0c4bc5fdb None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.779296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.780087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.780445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.780802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.784163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 801/1621] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:05.786742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.802749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e817c71-d2f2-456e-8308-6d7c6ad30e2d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.820412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.821841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.822323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.822764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.824660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.827661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.868437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.870030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.879864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 821/1622] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:05.880849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.892384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4e5d4-c4ca-4628-8812-16e40aeda647 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.898273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513c1a1-0029-48e4-84c0-f0b1c38c4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.899022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513c1a1-0029-48e4-84c0-f0b1c38c4278 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.899382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513c1a1-0029-48e4-84c0-f0b1c38c4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.899881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513c1a1-0029-48e4-84c0-f0b1c38c4278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.900698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513c1a1-0029-48e4-84c0-f0b1c38c4278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.903082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513c1a1-0029-48e4-84c0-f0b1c38c4278 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.920074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 822/1623] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:05.920074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac5bc-7514-4e1d-8dc1-7ad9b399af18 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.920074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac5bc-7514-4e1d-8dc1-7ad9b399af18 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.920074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ac5bc-7514-4e1d-8dc1-7ad9b399af18 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.922659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 823/1624] 10.222.0.91 () {54 vars in 961 bytes} [Mon Feb 21 01:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:09:05.922659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac5bc-7514-4e1d-8dc1-7ad9b399af18 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.939170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ac5bc-7514-4e1d-8dc1-7ad9b399af18 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.954247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 802/1625] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:05 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:05.954401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:05.955740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5bbcd-2f95-4695-8386-5f91f442258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.961507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bbcd-2f95-4695-8386-5f91f442258d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.961507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bbcd-2f95-4695-8386-5f91f442258d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.961507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5bbcd-2f95-4695-8386-5f91f442258d admin admin] PATH_INFO: `/v3/projects/1ebccbdbbb6e4d7aad2f814144031823/users/b084209fcd7442ff8c96fbc8fe586cc4/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.968272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee316b-421f-45c5-abbb-4ca3eecae814 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:05.977853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:05.978492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:05.978889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:05.979205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] PATH_INFO: `/v3/projects/f2ffbce3c33141bfb288cf4c63a23c5b/users/8dead52e25a947198e9457becafae3cf/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:05.986157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5bbcd-2f95-4695-8386-5f91f442258d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebccbdbbb6e4d7aad2f814144031823, user_id=b084209fcd7442ff8c96fbc8fe586cc4, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:05.989714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5bbcd-2f95-4695-8386-5f91f442258d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:05.998705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ffbce3c33141bfb288cf4c63a23c5b, user_id=8dead52e25a947198e9457becafae3cf, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.001493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.082659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 824/1626] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:05 2022] PUT /identity/v3/projects/1ebccbdbbb6e4d7aad2f814144031823/users/b084209fcd7442ff8c96fbc8fe586cc4/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:06.087443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.087744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.088054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.106965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:06.108342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:06.164758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 803/1627] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:05 2022] PUT /identity/v3/projects/f2ffbce3c33141bfb288cf4c63a23c5b/users/8dead52e25a947198e9457becafae3cf/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:06.165591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.191382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 825/1628] 10.222.0.91 () {58 vars in 1058 bytes} [Mon Feb 21 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:06.194814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.249377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846f957-2fb4-4f2a-8835-351cedf409f8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.256059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.258211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.258496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.258770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.260097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.261617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.274275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094130fb-3fe3-48a7-a4f9-4dd4ce2cf56f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.274498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 804/1629] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:06.275281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.280904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.282092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.282506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.282838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.283685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.285989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.293124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f72a-dee9-4a03-a502-209891fbb0d7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.298810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.305083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 826/1630] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:06.305257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.305425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.305584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.305584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.305584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.305584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.317827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 805/1631] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:06.319938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.331192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb762-3630-41cd-8ae4-cc91b3af6e7e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.338241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.339808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.345032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.345032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] PATH_INFO: `/v3/projects/f0b54f2d3b8d490a83675c6e4926aba4/users/205d175de8714fb588e3bfb1c4ed3556/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.364026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b54f2d3b8d490a83675c6e4926aba4, user_id=205d175de8714fb588e3bfb1c4ed3556, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.369042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.392549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792a971-edcf-4c69-b799-204578dc49bc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.400724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.401404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.401686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.402238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.468809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.470417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.484068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 827/1632] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:06.485112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.496889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 806/1633] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:06 2022] PUT /identity/v3/projects/f0b54f2d3b8d490a83675c6e4926aba4/users/205d175de8714fb588e3bfb1c4ed3556/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:06.497875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.525554 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17a8b1-da42-46fc-bb70-d384e028d8e4 service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.770053 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea79f85-18f3-4e29-92cb-2199539f5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.770758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336fa6a-c4c5-4c02-9e41-7375bc47b7be admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:06.771185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79f85-18f3-4e29-92cb-2199539f5d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.771932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79f85-18f3-4e29-92cb-2199539f5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.772207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea79f85-18f3-4e29-92cb-2199539f5d32 admin admin] PATH_INFO: `/v3/projects/1ebccbdbbb6e4d7aad2f814144031823/users/b084209fcd7442ff8c96fbc8fe586cc4/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.777147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79f85-18f3-4e29-92cb-2199539f5d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebccbdbbb6e4d7aad2f814144031823, user_id=b084209fcd7442ff8c96fbc8fe586cc4, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.779378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:06.780889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.781182 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.781467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] PATH_INFO: `/v3/projects/f2ffbce3c33141bfb288cf4c63a23c5b/users/8dead52e25a947198e9457becafae3cf/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.784238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea79f85-18f3-4e29-92cb-2199539f5d32 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.784677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ffbce3c33141bfb288cf4c63a23c5b, user_id=8dead52e25a947198e9457becafae3cf, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:06.787459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:06.805433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 807/1634] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:06 2022] PUT /identity/v3/projects/f2ffbce3c33141bfb288cf4c63a23c5b/users/8dead52e25a947198e9457becafae3cf/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:06.806630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:06.821627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 828/1635] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:06 2022] PUT /identity/v3/projects/1ebccbdbbb6e4d7aad2f814144031823/users/b084209fcd7442ff8c96fbc8fe586cc4/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:06.823503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca42433-797f-486c-ba05-8b7eb327c419 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:06.825636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca42433-797f-486c-ba05-8b7eb327c419 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:06.826035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca42433-797f-486c-ba05-8b7eb327c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:06.864924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-6ca42433-797f-486c-ba05-8b7eb327c419 None None] MFA Rules not processed for user `8dead52e25a947198e9457becafae3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:06.867168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6ca42433-797f-486c-ba05-8b7eb327c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:06.906704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9964d-7c94-4490-ac42-f3b44b310169 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.013852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 829/1636] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:07.015286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd180b-02f2-40e9-9f11-4f9967f277d7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.015733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd180b-02f2-40e9-9f11-4f9967f277d7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.016262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd180b-02f2-40e9-9f11-4f9967f277d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.051144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da246-d3d3-4a3d-810a-52e561835112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.051846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da246-d3d3-4a3d-810a-52e561835112 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.052151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da246-d3d3-4a3d-810a-52e561835112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.052461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da246-d3d3-4a3d-810a-52e561835112 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.053987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da246-d3d3-4a3d-810a-52e561835112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.054991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e2fd180b-02f2-40e9-9f11-4f9967f277d7 None None] MFA Rules not processed for user `b084209fcd7442ff8c96fbc8fe586cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:07.055541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63da246-d3d3-4a3d-810a-52e561835112 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.056583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e2fd180b-02f2-40e9-9f11-4f9967f277d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:07.079969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 808/1637] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:07.079969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c7d7c-ae42-427a-bf2c-9cd1246dc523 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.079969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c7d7c-ae42-427a-bf2c-9cd1246dc523 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.079969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c7d7c-ae42-427a-bf2c-9cd1246dc523 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.083268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 809/1638] 10.222.0.91 () {54 vars in 912 bytes} [Mon Feb 21 01:09:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:09:07.085101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c7d7c-ae42-427a-bf2c-9cd1246dc523 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:07.151473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c7d7c-ae42-427a-bf2c-9cd1246dc523 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.156009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.157096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.157642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.158129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.176602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.176602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.185324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 810/1639] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:07.186619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 830/1640] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:07.188247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48acc-df77-4c7b-9593-d8037836877c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.188655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48acc-df77-4c7b-9593-d8037836877c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.189033 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48acc-df77-4c7b-9593-d8037836877c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.191880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:07.205272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad53ca-7c07-448f-8769-0bd57d5d9b00 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.211775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.212931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.213279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.213885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] PATH_INFO: `/v3/projects/f0b54f2d3b8d490a83675c6e4926aba4/users/205d175de8714fb588e3bfb1c4ed3556/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.215874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b54f2d3b8d490a83675c6e4926aba4, user_id=205d175de8714fb588e3bfb1c4ed3556, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.216400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f8f48acc-df77-4c7b-9593-d8037836877c None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:07.217892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f8f48acc-df77-4c7b-9593-d8037836877c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:07.219311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.231449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 811/1641] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:07 2022] PUT /identity/v3/projects/f0b54f2d3b8d490a83675c6e4926aba4/users/205d175de8714fb588e3bfb1c4ed3556/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:07.232374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:07.308874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 831/1642] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:07.316970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.317530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.318015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.336022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb86-5e4b-45b7-832c-fd4a479a91a8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.340507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea65e3-f4c0-43db-b50c-725e62ffefe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.340761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea65e3-f4c0-43db-b50c-725e62ffefe9 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.341181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea65e3-f4c0-43db-b50c-725e62ffefe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.342505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea65e3-f4c0-43db-b50c-725e62ffefe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.358911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] MFA Rules not processed for user `205d175de8714fb588e3bfb1c4ed3556`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:07.361612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:07.482504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea65e3-f4c0-43db-b50c-725e62ffefe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.484502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea65e3-f4c0-43db-b50c-725e62ffefe9 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.496768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 832/1643] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:07.497641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:07.497823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 812/1644] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:07.511717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86db1ee-76c4-46fe-9062-f2096a6a1c5f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.516562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f03d6-095a-4787-9d05-4711de2995b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.517445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f03d6-095a-4787-9d05-4711de2995b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.517803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f03d6-095a-4787-9d05-4711de2995b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.518154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f03d6-095a-4787-9d05-4711de2995b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.561477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f37fa-3a6c-4246-bf22-da03aa22b6df None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.561477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f37fa-3a6c-4246-bf22-da03aa22b6df None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.561477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f37fa-3a6c-4246-bf22-da03aa22b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.593666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-361f37fa-3a6c-4246-bf22-da03aa22b6df None None] MFA Rules not processed for user `70516383f3b14d5283462803cac26d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:07.603300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-361f37fa-3a6c-4246-bf22-da03aa22b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:07.627391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f03d6-095a-4787-9d05-4711de2995b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.629762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f03d6-095a-4787-9d05-4711de2995b5 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.654152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 833/1645] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:07.684380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 813/1646] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:07.698531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.698850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.699097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.718123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] MFA Rules not processed for user `70516383f3b14d5283462803cac26d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:07.719424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:07.731622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 834/1647] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:07.747188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aaa41-6f16-4295-a40e-373ae73f2299 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.748698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aaa41-6f16-4295-a40e-373ae73f2299 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.749216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aaa41-6f16-4295-a40e-373ae73f2299 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.752311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 814/1648] 10.222.0.91 () {54 vars in 961 bytes} [Mon Feb 21 01:09:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:09:07.765467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:07.766524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.767063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.767536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.786356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b7e7e-e9d8-493f-a01a-0876bd08c97b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.791084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d9d76-358d-4722-97d9-e84ee73af12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.791786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d9d76-358d-4722-97d9-e84ee73af12f service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.793326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d9d76-358d-4722-97d9-e84ee73af12f service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.793326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d9d76-358d-4722-97d9-e84ee73af12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.800890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:07.803572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d9d76-358d-4722-97d9-e84ee73af12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.805071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d9d76-358d-4722-97d9-e84ee73af12f service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.806308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:07.818715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 815/1649] 10.222.0.91 () {58 vars in 1058 bytes} [Mon Feb 21 01:09:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:07.820248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 835/1650] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:07.828348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:07.847176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96501f-c733-432f-b079-ea0fee5c095c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:07.856788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f1f7d-5821-4226-8ce8-fc786f700da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:07.857446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f1f7d-5821-4226-8ce8-fc786f700da2 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:07.857732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f1f7d-5821-4226-8ce8-fc786f700da2 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:07.858007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f1f7d-5821-4226-8ce8-fc786f700da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:07.867216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f1f7d-5821-4226-8ce8-fc786f700da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:07.868885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f1f7d-5821-4226-8ce8-fc786f700da2 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:07.878417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 816/1651] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:08.161863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142183b-c198-4caf-a6e7-01b8a961bb73 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.162156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142183b-c198-4caf-a6e7-01b8a961bb73 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.162594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142183b-c198-4caf-a6e7-01b8a961bb73 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.167318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 836/1652] 10.222.0.91 () {54 vars in 912 bytes} [Mon Feb 21 01:09:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:09:08.174053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.174341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.174645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.191182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.191508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.191743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.199293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:08.201504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:08.218255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 817/1653] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:08.232410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:08.233929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:08.237778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] MFA Rules not processed for user `94dda2419e2242cc8102a08ad4c8c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:08.239377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:08.317529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d0fd-5dba-46b6-807d-c85137a4aee6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:08.324577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239f3af-7a9f-4aee-9da6-d4973ad3386f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:08.325245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239f3af-7a9f-4aee-9da6-d4973ad3386f service glance] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.325557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239f3af-7a9f-4aee-9da6-d4973ad3386f service glance] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.325886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239f3af-7a9f-4aee-9da6-d4973ad3386f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.359638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239f3af-7a9f-4aee-9da6-d4973ad3386f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:08.363556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a239f3af-7a9f-4aee-9da6-d4973ad3386f service glance] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:08.370632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 837/1654] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:08.372301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:08.391563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 818/1655] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:08.393229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.393362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d379-ba56-4ba0-908c-b70f3af69d99 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:08.394118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.394560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.400403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:08.402978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.408604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.408604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.432876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] MFA Rules not processed for user `94dda2419e2242cc8102a08ad4c8c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:08.436396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:08.455287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 819/1656] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:08.456629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:08.501524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:08.503070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:08.514268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 838/1657] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:08.559738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c73d0-6998-4f0f-b153-7dd4068147fa None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:08.568602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:08.570088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.570399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.570732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] PATH_INFO: `/v3/users/968ea024466f4ffdb16d7b96dbce44a0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.575814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968ea024466f4ffdb16d7b96dbce44a0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:08.577275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: WARNING py.warnings [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:08.577275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: warnings.warn(msg) Feb 21 01:09:08.577275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: Feb 21 01:09:08.581305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:08.734881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:08.753875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0874-e3f8-41d0-a86e-35d6e509afcb service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:08.762626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1b82e-5208-402c-8b70-04b37fd98214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:08.763800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b82e-5208-402c-8b70-04b37fd98214 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:08.764332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b82e-5208-402c-8b70-04b37fd98214 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:08.764802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1b82e-5208-402c-8b70-04b37fd98214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:08.782860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1b82e-5208-402c-8b70-04b37fd98214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:08.787673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1b82e-5208-402c-8b70-04b37fd98214 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:08.807487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 839/1658] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:08.944563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968ea024466f4ffdb16d7b96dbce44a0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:08.968007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968ea024466f4ffdb16d7b96dbce44a0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.023362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968ea024466f4ffdb16d7b96dbce44a0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.027517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968ea024466f4ffdb16d7b96dbce44a0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.028227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ddd0235d-1141-4739-af10-c02cf426fa40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968ea024466f4ffdb16d7b96dbce44a0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.095712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c939-cb28-4db9-a7d7-e7be757425ac None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.096036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c939-cb28-4db9-a7d7-e7be757425ac None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.096334 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1c939-cb28-4db9-a7d7-e7be757425ac None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.098251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 840/1659] 10.222.0.91 () {54 vars in 912 bytes} [Mon Feb 21 01:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:09:09.104322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.104807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.105216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.146475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 820/1660] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:08 2022] DELETE /identity/v3/users/968ea024466f4ffdb16d7b96dbce44a0 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:09.151681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.153040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.153528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.197855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] MFA Rules not processed for user `84fdc361782f47a2976d393a6b5e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:09.199103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:09.203337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:09.205995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:09.306915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 841/1661] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:09.307884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 821/1662] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:09.321472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:09.325892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:09.328868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:09.341296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9671-fda6-4c75-b89e-ced09c50decb None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:09.347323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:09.348363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.348891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.349374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.367466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:09.372118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e2a39-6053-4850-b510-ccbe5c5c7fdc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:09.372478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:09.384237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7300f10-219d-4bae-9be4-b636353d87ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:09.385036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300f10-219d-4bae-9be4-b636353d87ae service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.385414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300f10-219d-4bae-9be4-b636353d87ae service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.386404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300f10-219d-4bae-9be4-b636353d87ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.393269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 842/1663] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:09.424154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7300f10-219d-4bae-9be4-b636353d87ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:09.426343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7300f10-219d-4bae-9be4-b636353d87ae service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:09.452587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 822/1664] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:09.541093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:09.542693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:09.560981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa743b-6f8c-4e2b-86c6-f88b090565f3 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:09.577129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:09.578078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.578380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.578702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] PATH_INFO: `/v3/users/18cdae0c50d54b7e9e91fe46b965013d` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.580083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cdae0c50d54b7e9e91fe46b965013d)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:09.582614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:09.672394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced6ff5-6be4-42a1-af74-056a1e92b69f None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.672685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced6ff5-6be4-42a1-af74-056a1e92b69f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.676378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced6ff5-6be4-42a1-af74-056a1e92b69f None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.676378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 823/1665] 10.222.0.91 () {54 vars in 912 bytes} [Mon Feb 21 01:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:09:09.681267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.681772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.683126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.716272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] MFA Rules not processed for user `84fdc361782f47a2976d393a6b5e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:09.716272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:09.719297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 824/1666] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:09.737096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:09.738670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:09.749447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e39c5-de83-4feb-8521-9771d06f3498 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:09.753902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016c3e6-39f7-4575-9355-9331dbf37aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:09.755249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c3e6-39f7-4575-9355-9331dbf37aae service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:09.755608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c3e6-39f7-4575-9355-9331dbf37aae service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:09.756252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016c3e6-39f7-4575-9355-9331dbf37aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:09.766583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016c3e6-39f7-4575-9355-9331dbf37aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:09.768260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016c3e6-39f7-4575-9355-9331dbf37aae service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:09.777992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 825/1667] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:09.854690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cdae0c50d54b7e9e91fe46b965013d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.855586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cdae0c50d54b7e9e91fe46b965013d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.876523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cdae0c50d54b7e9e91fe46b965013d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.915166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cdae0c50d54b7e9e91fe46b965013d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:09.917157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5348c87e-8b2d-48a0-b7e4-1421fcb29c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cdae0c50d54b7e9e91fe46b965013d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:10.016845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 843/1668] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:09 2022] DELETE /identity/v3/users/18cdae0c50d54b7e9e91fe46b965013d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:10.023981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:10.024918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:10.025202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:10.051584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:10.054743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:10.129604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf60413-03b9-433a-99f5-b8f0948afba7 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:10.129829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf60413-03b9-433a-99f5-b8f0948afba7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:10.129928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf60413-03b9-433a-99f5-b8f0948afba7 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:10.132788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 844/1669] 10.222.0.91 () {54 vars in 960 bytes} [Mon Feb 21 01:09:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:09:10.143372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:10.145039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:10.145702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:10.174733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:10.183443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:10.198233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 826/1670] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:10.217992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:10.219490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:10.344128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dd46a-2043-4c8c-83c3-0d1e35e86254 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:10.352861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:10.353580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:10.353790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:10.354065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:10.378893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:10.389412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:10.415998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 827/1671] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:10.416871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:10.419219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:10.423669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 845/1672] 10.222.0.91 () {58 vars in 1057 bytes} [Mon Feb 21 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:10.432364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:10.448771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35be3f-170b-437a-94ce-a040d40606be None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:10.465226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486fc7-33a0-4dde-8478-22f34977a975 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:10.466222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:10.467575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:10.467575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:10.467828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:10.473869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:10.489370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:10.490351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:10.490622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:10.490992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] PATH_INFO: `/v3/projects/ee124c48dce94fb99528d9a0e30d3a84` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:10.494125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee124c48dce94fb99528d9a0e30d3a84)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:10.495419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:10.498081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:10.504663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:10.521080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 846/1673] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:10.719134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee124c48dce94fb99528d9a0e30d3a84', 'request_id': 'req-a066aac9-9379-4343-8faa-b5cd619554e1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:10.742969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee124c48dce94fb99528d9a0e30d3a84', 'request_id': 'req-a066aac9-9379-4343-8faa-b5cd619554e1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:10.877230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee124c48dce94fb99528d9a0e30d3a84', 'request_id': 'req-a066aac9-9379-4343-8faa-b5cd619554e1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:10.904207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] The token cache is being invalidate because project ee124c48dce94fb99528d9a0e30d3a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:10.905269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:10.906825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:10.910072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 828/1674] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:10 2022] DELETE /identity/v3/projects/ee124c48dce94fb99528d9a0e30d3a84 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:10.921149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:10.928977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f5f66-abbc-4195-befb-a27f6023abb2 service placement] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:11.018309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:11.020931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:11.021697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:11.022436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] PATH_INFO: `/v3/users/b084209fcd7442ff8c96fbc8fe586cc4` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:11.024359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b084209fcd7442ff8c96fbc8fe586cc4)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:11.027481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:11.345915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b084209fcd7442ff8c96fbc8fe586cc4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:11.347498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b084209fcd7442ff8c96fbc8fe586cc4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:11.357976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b084209fcd7442ff8c96fbc8fe586cc4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:11.380973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b084209fcd7442ff8c96fbc8fe586cc4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:11.381817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b084209fcd7442ff8c96fbc8fe586cc4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:11.453566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:11.464215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 847/1675] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:10 2022] DELETE /identity/v3/users/b084209fcd7442ff8c96fbc8fe586cc4 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:11.473708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:11.535061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a066aac9-9379-4343-8faa-b5cd619554e1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:11.723613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:11.725659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:11.726054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:11.726501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] PATH_INFO: `/v3/projects/b599acdadf39479e8590919e6d61e938` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:11.728236 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b599acdadf39479e8590919e6d61e938)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:11.731407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:11.937988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b599acdadf39479e8590919e6d61e938', 'request_id': 'req-57883292-b1f4-48ae-a5a9-6da5de15e7c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:11.944538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b599acdadf39479e8590919e6d61e938', 'request_id': 'req-57883292-b1f4-48ae-a5a9-6da5de15e7c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.072373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b599acdadf39479e8590919e6d61e938', 'request_id': 'req-57883292-b1f4-48ae-a5a9-6da5de15e7c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.095786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] The token cache is being invalidate because project b599acdadf39479e8590919e6d61e938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:12.096176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.097336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.104151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 829/1676] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:11 2022] DELETE /identity/v3/projects/b599acdadf39479e8590919e6d61e938 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:12.107748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:12.111471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:12.134816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1972f-cce6-4567-bab5-7a13c2ca8b7b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:12.278559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:12.279464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:12.279746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:12.280070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] PATH_INFO: `/v3/users/8dead52e25a947198e9457becafae3cf` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:12.282385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dead52e25a947198e9457becafae3cf)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:12.284368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:12.935278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:12.935278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:12.935278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57883292-b1f4-48ae-a5a9-6da5de15e7c5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:12.977556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dead52e25a947198e9457becafae3cf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.977556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dead52e25a947198e9457becafae3cf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.982663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:12.982663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:12.982663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:12.982663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] PATH_INFO: `/v3/projects/1ebccbdbbb6e4d7aad2f814144031823` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:12.984251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebccbdbbb6e4d7aad2f814144031823)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:12.984251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:12.989656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dead52e25a947198e9457becafae3cf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.989656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dead52e25a947198e9457becafae3cf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.989656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dead52e25a947198e9457becafae3cf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.989656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 848/1677] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:12 2022] DELETE /identity/v3/users/8dead52e25a947198e9457becafae3cf => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:12.989656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:12.995056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:12.996200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebccbdbbb6e4d7aad2f814144031823', 'request_id': 'req-078aeb57-0b09-454f-993e-7c09d4d1c516'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:12.996200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebccbdbbb6e4d7aad2f814144031823', 'request_id': 'req-078aeb57-0b09-454f-993e-7c09d4d1c516'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.003311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f806b-f855-436e-8cf1-7cf4bae8929a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:13.009561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:13.010464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.010763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.011078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] PATH_INFO: `/v3/users/088087774f514bc6a4d2f8c28fecee2f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.014968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=088087774f514bc6a4d2f8c28fecee2f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:13.017147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:13.117375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebccbdbbb6e4d7aad2f814144031823', 'request_id': 'req-078aeb57-0b09-454f-993e-7c09d4d1c516'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.134821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] The token cache is being invalidate because project 1ebccbdbbb6e4d7aad2f814144031823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:13.135443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.136510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-078aeb57-0b09-454f-993e-7c09d4d1c516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.139976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 830/1678] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:12 2022] DELETE /identity/v3/projects/1ebccbdbbb6e4d7aad2f814144031823 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:13.142103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619995aa-aab7-4cb8-85ab-191b9e793513 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.142580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619995aa-aab7-4cb8-85ab-191b9e793513 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.143451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619995aa-aab7-4cb8-85ab-191b9e793513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.182753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-619995aa-aab7-4cb8-85ab-191b9e793513 None None] MFA Rules not processed for user `8287f43e83034c0a80ee051456d502c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:13.184061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-619995aa-aab7-4cb8-85ab-191b9e793513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.434481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088087774f514bc6a4d2f8c28fecee2f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.435391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088087774f514bc6a4d2f8c28fecee2f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.437547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 831/1679] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:13.438912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352aff-0c6d-452a-b603-6390ed72c3b4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.439203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352aff-0c6d-452a-b603-6390ed72c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.439480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352aff-0c6d-452a-b603-6390ed72c3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.446445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088087774f514bc6a4d2f8c28fecee2f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.491398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088087774f514bc6a4d2f8c28fecee2f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.496870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088087774f514bc6a4d2f8c28fecee2f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:13.531525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-28352aff-0c6d-452a-b603-6390ed72c3b4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:13.532948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-28352aff-0c6d-452a-b603-6390ed72c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.558712 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 832/1680] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:13.560337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5e32f-7455-496d-b95d-29fe9a520a53 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.561282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5e32f-7455-496d-b95d-29fe9a520a53 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.561695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5e32f-7455-496d-b95d-29fe9a520a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.603158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e2a5e32f-7455-496d-b95d-29fe9a520a53 None None] MFA Rules not processed for user `8287f43e83034c0a80ee051456d502c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:13.605324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e2a5e32f-7455-496d-b95d-29fe9a520a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.644243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 833/1681] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:13.651681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337b95-e7ab-41c6-9a41-9c6b99a2523a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.651681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337b95-e7ab-41c6-9a41-9c6b99a2523a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.651681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337b95-e7ab-41c6-9a41-9c6b99a2523a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.661269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 849/1682] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:12 2022] DELETE /identity/v3/users/088087774f514bc6a4d2f8c28fecee2f => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:13.663964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:13.668196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.693094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bd337b95-e7ab-41c6-9a41-9c6b99a2523a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:13.695075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bd337b95-e7ab-41c6-9a41-9c6b99a2523a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.789778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31e36d-5bf7-469a-a38a-9a5e2f31c676 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:13.797390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:13.798212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.798570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.798964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.801778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.880497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 834/1683] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:13.887636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298682-0668-4260-b88f-1dec0be01211 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:13.888149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298682-0668-4260-b88f-1dec0be01211 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:13.897039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298682-0668-4260-b88f-1dec0be01211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:13.948423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-74298682-0668-4260-b88f-1dec0be01211 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:13.950294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:13.952171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-74298682-0668-4260-b88f-1dec0be01211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.955884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:13.964795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 850/1684] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:13.969647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 835/1685] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:13.980019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:13.981024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298682-0668-4260-b88f-1dec0be01211 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:13.981889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:13.995968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298682-0668-4260-b88f-1dec0be01211 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.004861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.007033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.007659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.008035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.012828 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:14.013153 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.015369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.019014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223322c-1553-47be-bb9d-b0006fc07935 service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.029679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.030531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.030919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.031160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] PATH_INFO: `/v3/projects/f2ffbce3c33141bfb288cf4c63a23c5b` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.036388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ffbce3c33141bfb288cf4c63a23c5b)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.039132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING py.warnings [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 01:09:14.039132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: warnings.warn(msg) Feb 21 01:09:14.039132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: Feb 21 01:09:14.040440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.059513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 836/1686] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:14.066409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.069768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:14.153693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6f952-9c62-427f-9a20-47a2c5f22a62 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.163203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.164318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.164818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.165332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.185752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.188692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.203494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 837/1687] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:14.204718 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.220020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc6678-5cbf-414e-9660-145865d4dc55 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.225773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ffbce3c33141bfb288cf4c63a23c5b', 'request_id': 'req-dc70e3ef-29a3-4708-a636-853d0f5aa7df'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:14.244712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ffbce3c33141bfb288cf4c63a23c5b', 'request_id': 'req-dc70e3ef-29a3-4708-a636-853d0f5aa7df'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:14.265889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ffbce3c33141bfb288cf4c63a23c5b', 'request_id': 'req-dc70e3ef-29a3-4708-a636-853d0f5aa7df'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:14.295156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.296025 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.296319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.296597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.297441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.299404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.360347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] The token cache is being invalidate because project f2ffbce3c33141bfb288cf4c63a23c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:14.361446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:14.364143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc70e3ef-29a3-4708-a636-853d0f5aa7df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:14.367099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 851/1688] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:13 2022] DELETE /identity/v3/projects/f2ffbce3c33141bfb288cf4c63a23c5b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:14.375138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1c461-4829-43e4-b3b2-0dea5d524cba None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.375660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1c461-4829-43e4-b3b2-0dea5d524cba None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.376219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1c461-4829-43e4-b3b2-0dea5d524cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.399025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c4e1c461-4829-43e4-b3b2-0dea5d524cba None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:14.400320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c4e1c461-4829-43e4-b3b2-0dea5d524cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:14.422884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 852/1689] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:14.428589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.429532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.429820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.448247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 838/1690] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:14 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:14.453460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.455703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:14.457006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:14.462171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:14.578534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b0f5a-448a-43a3-8a54-56e6fd9f81cd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.584980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.585846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.586384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.586730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.587626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.590488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.628439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 853/1691] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:14.632823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.658995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d8921-3569-4c65-94ea-b75f0ec44aab None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.669331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.670456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.670992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.675653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 839/1692] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:14 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:14.675853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.675853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:14.675853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.675853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.676655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.697922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39275fc0-f493-4423-9f33-ce878133a8b8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.700184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 854/1693] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:14.701348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.713524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.714208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.714488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.714768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.715510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.715694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd7f26-f24f-42a8-ae8f-42dc37e45e2c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.717561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.722947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.725412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.725853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.726301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.727185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.729713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.743218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 840/1694] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:14.749315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.767662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97548fd0-168c-4b17-8d8d-5bac1a61ab5b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.780732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.781431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.783796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.783796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.783796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.784808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.806992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 841/1695] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:14.808557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:14.828412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863594a1-dd80-46a3-8875-6fc67a33315a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:14.842213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea14e-4306-4a80-8f37-500422552e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:14.846628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea14e-4306-4a80-8f37-500422552e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:14.846628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea14e-4306-4a80-8f37-500422552e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:14.846628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea14e-4306-4a80-8f37-500422552e2a admin admin] PATH_INFO: `/v3/projects/4185e17a66f0447a8f1a63763e74dbd3/users/5234c71fd42b4b819c97a202deeeb4db/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:14.871086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ea14e-4306-4a80-8f37-500422552e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4185e17a66f0447a8f1a63763e74dbd3, user_id=5234c71fd42b4b819c97a202deeeb4db, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:14.877462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ea14e-4306-4a80-8f37-500422552e2a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:14.887898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 855/1696] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:14 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:14.888874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:15.001018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 842/1697] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:14 2022] PUT /identity/v3/projects/4185e17a66f0447a8f1a63763e74dbd3/users/5234c71fd42b4b819c97a202deeeb4db/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:15.012850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:15.013316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:15.013956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:15.110775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] MFA Rules not processed for user `5234c71fd42b4b819c97a202deeeb4db`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:15.116820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:15.179088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ecf80-1956-466f-8954-70ffec05bdf9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:15.344664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:15.345357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:15.346064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:15.346357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:15.347084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:15.350258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:15.436127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 856/1698] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:14 2022] POST /identity/v3/users => generated 286 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:15.437070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:15.446767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:15.447385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 843/1699] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:15.449129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:15.485601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b863e0-94da-4173-b69a-2058cc4c455c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:15.502162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:15.502162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:15.502162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:15.502162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:15.502605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:15.505178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:15.519875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049274-4532-47c6-a380-cb33e6e93abb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:15.520542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 844/1700] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:15.521103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:15.534604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e8f6-2a8d-4bee-9b81-fbfceff7c3b8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:15.541032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:15.541839 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:15.542220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:15.542771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:15.543578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:15.545918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:15.565248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:15.566140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:15.566453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:15.566771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] PATH_INFO: `/v3/projects/c4d5bc43b26f4e53987f61680e58e4d0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:15.568889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d5bc43b26f4e53987f61680e58e4d0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:15.571560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:15.704297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 845/1701] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:15 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:15.705419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:15.840347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d5bc43b26f4e53987f61680e58e4d0', 'request_id': 'req-0434e05a-6eeb-4d86-8182-bcbb9128d951'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:15.864709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d5bc43b26f4e53987f61680e58e4d0', 'request_id': 'req-0434e05a-6eeb-4d86-8182-bcbb9128d951'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:15.881392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d5bc43b26f4e53987f61680e58e4d0', 'request_id': 'req-0434e05a-6eeb-4d86-8182-bcbb9128d951'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:15.883771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd34ce-c592-4c94-8b01-9b62a5a7bbb2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.014054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] The token cache is being invalidate because project c4d5bc43b26f4e53987f61680e58e4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:16.024476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:16.025755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0434e05a-6eeb-4d86-8182-bcbb9128d951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:16.035610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 857/1702] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:15 2022] DELETE /identity/v3/projects/c4d5bc43b26f4e53987f61680e58e4d0 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:16.039709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6fdf-3f03-4d04-8550-beb183d108ee None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.040674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6fdf-3f03-4d04-8550-beb183d108ee None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.041928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df6fdf-3f03-4d04-8550-beb183d108ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.053216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.054222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.054575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.054924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.055735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.057553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:16.079603 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 846/1703] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:16.081542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:16.083583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.088873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-46df6fdf-3f03-4d04-8550-beb183d108ee None None] MFA Rules not processed for user `8287f43e83034c0a80ee051456d502c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:16.090288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-46df6fdf-3f03-4d04-8550-beb183d108ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.120027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85f758-4c5f-4c81-9efd-559928310a07 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.130456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4280a8-a294-4ede-af78-fae302814dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.131666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4280a8-a294-4ede-af78-fae302814dfa admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.132011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4280a8-a294-4ede-af78-fae302814dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.132259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4280a8-a294-4ede-af78-fae302814dfa admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.132967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4280a8-a294-4ede-af78-fae302814dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.135703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4280a8-a294-4ede-af78-fae302814dfa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:16.206889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 858/1704] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:16.211337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.211337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.211337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.231057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 847/1705] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:16.233262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.233787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.234251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.251258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:16.252497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.276578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:16.278251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.305027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 848/1706] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:16.305027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:16.305027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.348770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edfaf0-aacd-4e3e-9b08-6f815add1896 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.360765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1dca-0be9-4b1d-bf64-9c6fb970c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.361677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1dca-0be9-4b1d-bf64-9c6fb970c57d admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.361956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1dca-0be9-4b1d-bf64-9c6fb970c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.362233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1dca-0be9-4b1d-bf64-9c6fb970c57d admin admin] PATH_INFO: `/v3/projects/9435a9d7a20b4e4fb7768495d4d0e229/users/083fd7acaf534eaa8c336850f22cc06c/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.403360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1dca-0be9-4b1d-bf64-9c6fb970c57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9435a9d7a20b4e4fb7768495d4d0e229, user_id=083fd7acaf534eaa8c336850f22cc06c, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.409144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f1dca-0be9-4b1d-bf64-9c6fb970c57d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:16.427231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 859/1707] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:16.432114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:16.508447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735ad06-64ef-4c52-b0b2-38659ae9b65b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.522127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cad8a-fac5-4195-baab-7573ce0be0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.523728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cad8a-fac5-4195-baab-7573ce0be0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.524230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cad8a-fac5-4195-baab-7573ce0be0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.524672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cad8a-fac5-4195-baab-7573ce0be0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.526564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cad8a-fac5-4195-baab-7573ce0be0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.529405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cad8a-fac5-4195-baab-7573ce0be0c4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:16.558924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 849/1708] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:16 2022] PUT /identity/v3/projects/9435a9d7a20b4e4fb7768495d4d0e229/users/083fd7acaf534eaa8c336850f22cc06c/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:16.564037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.564759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.565575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.574877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 860/1709] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:16.578170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.579295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.582064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.640430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:16.642471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.682872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:16.687873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:16.784335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 850/1710] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:16.785210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:16.814347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039154-abac-43ac-b2a7-8e5ff01c5c2e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.821489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.822399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.822683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.822970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] PATH_INFO: `/v3/projects/1cee12ff4ae24906b9712b5a944c8a05/users/32894e880c1d43289131f7211535644b/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.842928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 861/1711] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:16.844684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:16.855131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cee12ff4ae24906b9712b5a944c8a05, user_id=32894e880c1d43289131f7211535644b, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.858197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:16.868211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09615e48-c9dc-4c78-841d-b4e5f451cc47 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.876718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.877672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.878479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.878910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.879944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:16.880441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.884441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:16.909973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 862/1712] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:16.914839 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:16.926981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b458388-1a0c-4c02-b398-351ab97dc017 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:16.940154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:16.940836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:16.941352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:16.958005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:16.958005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:16.978542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.010156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 851/1713] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:16 2022] PUT /identity/v3/projects/1cee12ff4ae24906b9712b5a944c8a05/users/32894e880c1d43289131f7211535644b/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:17.012316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.015678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:17.146865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ac204-f3a8-4852-97ea-5c7b3b209711 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:17.163237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:17.168292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.168292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.168292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.174140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 863/1714] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:16 2022] POST /identity/v3/projects => generated 375 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:17.178574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.189659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:17.349327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:17.363752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a57e6-551f-44bd-afcc-6d5733be20eb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:17.363926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.365561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:17.366866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.367035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.367607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.393368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 852/1715] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:17.395469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.415339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8f325-205e-4658-892b-136879ea554e service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:17.538260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fbe1f-15bc-4533-a304-d84eb9445509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:17.541820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:17.545207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fbe1f-15bc-4533-a304-d84eb9445509 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.545549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fbe1f-15bc-4533-a304-d84eb9445509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.551719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fbe1f-15bc-4533-a304-d84eb9445509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.552095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.552185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fbe1f-15bc-4533-a304-d84eb9445509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:17.553989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fbe1f-15bc-4533-a304-d84eb9445509 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.565971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 864/1716] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:09:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:09:17.580661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.592494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 853/1717] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:17.597048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.597346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.602190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.624330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff9af-123e-458a-ab18-357cb51ea110 service swift] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:17.643742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] MFA Rules not processed for user `84fdc361782f47a2976d393a6b5e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:17.647808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:17.649787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:17.653526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.653825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.655930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.657531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:17.667345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.789830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 865/1718] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:17 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:17.789830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.837596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 854/1719] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Feb 21 01:09:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:17.840050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.840413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cb97d-25c2-4f17-9034-f3be83e25160 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:17.870659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:17.873573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.873573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.874110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] PATH_INFO: `/v3/projects/1cee12ff4ae24906b9712b5a944c8a05/users/32894e880c1d43289131f7211535644b/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.889288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cab308-cc1d-450e-95a1-ff81f9f322ab None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:17.890384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cee12ff4ae24906b9712b5a944c8a05, user_id=32894e880c1d43289131f7211535644b, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:17.901572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.907418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743d72c-871c-425d-90f6-e80842d5463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:17.910675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d72c-871c-425d-90f6-e80842d5463a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:17.919092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d72c-871c-425d-90f6-e80842d5463a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:17.919715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743d72c-871c-425d-90f6-e80842d5463a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:17.920656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743d72c-871c-425d-90f6-e80842d5463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:17.932360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743d72c-871c-425d-90f6-e80842d5463a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:17.951805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 866/1720] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:17 2022] PUT /identity/v3/projects/1cee12ff4ae24906b9712b5a944c8a05/users/32894e880c1d43289131f7211535644b/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:17.953731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:17.961158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:18.011488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 855/1721] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:18.024951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:18.026844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:18.029122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:18.150943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] MFA Rules not processed for user `32894e880c1d43289131f7211535644b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:18.153853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee414-520b-495e-b566-4c4d7a8a417c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:18.162821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:18.163655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:18.164118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:18.164401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:18.165569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:18.202773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:18.213191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:18.259424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 867/1722] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:18.260428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:18.436178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 856/1723] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:18.463812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:18.465373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:18.530069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be192444-b816-4c6a-95c2-9d812e1e4151 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:18.541675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:18.545680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:18.547333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:18.548681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:18.549441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:18.556545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:18.591869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 868/1724] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:18.592918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:18.622715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e32773-6921-4526-bd96-975232c090e4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:18.638381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:18.639293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:18.639582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:18.640154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] PATH_INFO: `/v3/projects/3e8af25034e24c7f81def4c24dee0e1f/users/97b76ed95fc847f483b5cedd686cd7c7/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:18.644226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f0186-149f-4307-9c97-a7b1f3e0d368 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:18.672184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaddafe-15f3-4c09-bf95-7a0b3ba78118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:18.672184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaddafe-15f3-4c09-bf95-7a0b3ba78118 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:18.672184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaddafe-15f3-4c09-bf95-7a0b3ba78118 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:18.674812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaddafe-15f3-4c09-bf95-7a0b3ba78118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:18.705701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaddafe-15f3-4c09-bf95-7a0b3ba78118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:18.707528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8af25034e24c7f81def4c24dee0e1f, user_id=97b76ed95fc847f483b5cedd686cd7c7, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:18.711020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaddafe-15f3-4c09-bf95-7a0b3ba78118 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:18.718561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:18.752165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 857/1725] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:18.826180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 869/1726] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:18 2022] PUT /identity/v3/projects/3e8af25034e24c7f81def4c24dee0e1f/users/97b76ed95fc847f483b5cedd686cd7c7/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:18.845627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:18.846601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:18.847037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:18.944443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] MFA Rules not processed for user `97b76ed95fc847f483b5cedd686cd7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:18.948651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:19.129708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 858/1727] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:19.132000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:19.134166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:19.217346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:19.329224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f92cf9-36bd-427d-8de7-c2c2765088f2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:19.360762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:19.361940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:19.364166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:19.364661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:19.417884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:19.419151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446593e-6253-4d9a-ae25-885102c0067a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:19.421116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:19.455082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:19.459898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:19.460313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:19.460602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:19.466804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 870/1728] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:19.471070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:19.720957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:19.723257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc695a-ef5d-4226-a20c-67f071f549a6 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:19.758079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 859/1729] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:20.975035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:21.090015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb59b-5afe-4f2c-a72d-7c9183c3024e service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:21.097817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:21.100897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:21.103769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:21.103769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] PATH_INFO: `/v3/users/97b76ed95fc847f483b5cedd686cd7c7` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:21.103769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b76ed95fc847f483b5cedd686cd7c7)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:21.105736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:21.499185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b76ed95fc847f483b5cedd686cd7c7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:21.500286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b76ed95fc847f483b5cedd686cd7c7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:21.538738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b76ed95fc847f483b5cedd686cd7c7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:21.593641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b76ed95fc847f483b5cedd686cd7c7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:21.595738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7948d35a-1ebb-48ba-bb0e-de429411cfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b76ed95fc847f483b5cedd686cd7c7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:21.694459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb6bda-6559-4eb1-9f34-45b49f080aa1 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:21.694954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb6bda-6559-4eb1-9f34-45b49f080aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:21.695053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb6bda-6559-4eb1-9f34-45b49f080aa1 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:21.697117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 860/1730] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:09:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:09:21.706669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 871/1731] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:20 2022] DELETE /identity/v3/users/97b76ed95fc847f483b5cedd686cd7c7 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:21.714416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52376-dfc7-4d12-b8c4-a50198da3661 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:21.718700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52376-dfc7-4d12-b8c4-a50198da3661 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:21.719099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da52376-dfc7-4d12-b8c4-a50198da3661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:21.767195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36446ffe-0c16-46e0-a844-65226bd749ad None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:21.767930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36446ffe-0c16-46e0-a844-65226bd749ad None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:21.770572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36446ffe-0c16-46e0-a844-65226bd749ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:21.785855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8da52376-dfc7-4d12-b8c4-a50198da3661 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:21.795147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8da52376-dfc7-4d12-b8c4-a50198da3661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:21.821967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-36446ffe-0c16-46e0-a844-65226bd749ad None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:21.826257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-36446ffe-0c16-46e0-a844-65226bd749ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:22.012476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 861/1732] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:22.014960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.017462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.017567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.086008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 872/1733] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:22.088972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62996aa-3366-4d0a-81f8-89b2cc4d357b None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.089468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62996aa-3366-4d0a-81f8-89b2cc4d357b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.089897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62996aa-3366-4d0a-81f8-89b2cc4d357b None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.093297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 873/1734] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:09:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:09:22.105300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] MFA Rules not processed for user `083fd7acaf534eaa8c336850f22cc06c`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:22.107129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:22.236656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 862/1735] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:22.238274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62996aa-3366-4d0a-81f8-89b2cc4d357b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:22.242957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b62996aa-3366-4d0a-81f8-89b2cc4d357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:22.264210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62996aa-3366-4d0a-81f8-89b2cc4d357b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:22.291472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:22.292917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.294090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.294626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.301209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:22.303791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:22.439767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 874/1736] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:22 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:22.441524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:22.478899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218438d-6ebd-4230-93e3-594f88077c5e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:22.580294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:22.581262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.581908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.583029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.584408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:22.594275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:22.650555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:22.652616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:22.783225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 863/1737] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:22 2022] POST /identity/v3/users => generated 293 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:22.784130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:22.789273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:22.819568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7266c2-d8e0-4a5f-9104-c915f7220931 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:22.827465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ee43d-403f-4b26-83cb-ad1509951e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:22.833410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee43d-403f-4b26-83cb-ad1509951e1c service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.833410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee43d-403f-4b26-83cb-ad1509951e1c service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.833410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ee43d-403f-4b26-83cb-ad1509951e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.840672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ee43d-403f-4b26-83cb-ad1509951e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:22.842549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ee43d-403f-4b26-83cb-ad1509951e1c service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:22.857003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 875/1738] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:22.858808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.858997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.859286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.932991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:22.940079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:22.962168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8409-875e-4d2d-9a9d-4e9775cef231 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:22.968519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:22.969209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:22.969591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:22.970000 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:22.987893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 876/1739] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:22.989422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:23.019617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.021878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.036069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 864/1740] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:23.038114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba9aeb-7344-4678-8c6d-86ae076ab3b5 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:23.046537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:23.058971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:23.058971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:23.058971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:23.058971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.058971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.081017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 877/1741] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:23.085380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:23.098571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3eee3-41ea-4a27-82f5-3addbffe2776 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:23.107655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:23.108849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:23.109214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:23.109771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] PATH_INFO: `/v3/projects/e23f1cbf89244625a52a1cc4fd053069/users/86206d7462644827a713e04a8a60c28b/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:23.152940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23f1cbf89244625a52a1cc4fd053069, user_id=86206d7462644827a713e04a8a60c28b, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.167625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.293056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 865/1742] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:23 2022] PUT /identity/v3/projects/e23f1cbf89244625a52a1cc4fd053069/users/86206d7462644827a713e04a8a60c28b/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:23.293280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:23.293280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:23.298772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:23.350172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f0cd1-ff01-45de-820a-b6440068e210 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:23.506888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d3fd5-d133-438b-a965-0ecb7f45c387 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:23.526569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:23.527745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:23.527745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:23.527745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:23.529234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.530483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.565584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 866/1743] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:23.573963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:23.585650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:23.611813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:23.611813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:23.611813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:23.611813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] PATH_INFO: `/v3/users/7606ed2906ed4a04b7ec43a37a1d7fc0` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:23.612552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7606ed2906ed4a04b7ec43a37a1d7fc0)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.617189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.805011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de7346-df5e-435a-8075-56bce8bbb18c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:23.816129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416270-2027-439e-8461-6855103f727f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:23.817176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416270-2027-439e-8461-6855103f727f service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:23.818227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416270-2027-439e-8461-6855103f727f service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:23.819035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65416270-2027-439e-8461-6855103f727f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:23.845319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416270-2027-439e-8461-6855103f727f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.847372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65416270-2027-439e-8461-6855103f727f service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.880661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 867/1744] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:23.894525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416270-2027-439e-8461-6855103f727f service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:23.908292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65416270-2027-439e-8461-6855103f727f service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:23.916157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82890b82-4436-4b54-af3e-1e02b0712159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:23.919249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82890b82-4436-4b54-af3e-1e02b0712159 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:23.919596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82890b82-4436-4b54-af3e-1e02b0712159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:23.919901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82890b82-4436-4b54-af3e-1e02b0712159 admin admin] PATH_INFO: `/v3/projects/e23f1cbf89244625a52a1cc4fd053069/users/86206d7462644827a713e04a8a60c28b/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:23.923540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82890b82-4436-4b54-af3e-1e02b0712159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23f1cbf89244625a52a1cc4fd053069, user_id=86206d7462644827a713e04a8a60c28b, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:23.933667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7606ed2906ed4a04b7ec43a37a1d7fc0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:23.934029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82890b82-4436-4b54-af3e-1e02b0712159 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:23.936618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7606ed2906ed4a04b7ec43a37a1d7fc0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:23.960587 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7606ed2906ed4a04b7ec43a37a1d7fc0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:23.967322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 868/1745] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:23 2022] PUT /identity/v3/projects/e23f1cbf89244625a52a1cc4fd053069/users/86206d7462644827a713e04a8a60c28b/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:24.010153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7606ed2906ed4a04b7ec43a37a1d7fc0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:24.011053 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7606ed2906ed4a04b7ec43a37a1d7fc0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:24.081411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 878/1746] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:23 2022] DELETE /identity/v3/users/7606ed2906ed4a04b7ec43a37a1d7fc0 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:24.086722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:24.086996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:24.087250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:24.117919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:24.119088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:24.225366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 869/1747] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:24.274537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:24.276609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:24.419252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0b6d1-e530-42b9-b960-bca51e891f28 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:24.436668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:24.437356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:24.437709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:24.438092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:24.463028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:24.464588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:24.482536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 879/1748] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:25.620020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:25.621484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:25.645535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258b929-aa44-4a5c-93c5-3f582ce8ffad None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:25.647202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:25.648239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:25.648601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:25.648954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] PATH_INFO: `/v3/projects/3e8af25034e24c7f81def4c24dee0e1f` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:25.650298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8af25034e24c7f81def4c24dee0e1f)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:25.652519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:25.879862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8af25034e24c7f81def4c24dee0e1f', 'request_id': 'req-3bea6112-6989-4adb-968a-c7328b180f03'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:25.888676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8af25034e24c7f81def4c24dee0e1f', 'request_id': 'req-3bea6112-6989-4adb-968a-c7328b180f03'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:25.924475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:25.928260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:25.945173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90046e-b8d3-4432-9638-4aa9fe0be3dd service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.000453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8af25034e24c7f81def4c24dee0e1f', 'request_id': 'req-3bea6112-6989-4adb-968a-c7328b180f03'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.020234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] The token cache is being invalidate because project 3e8af25034e24c7f81def4c24dee0e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:26.020864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.021866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3bea6112-6989-4adb-968a-c7328b180f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.023797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 870/1749] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:25 2022] DELETE /identity/v3/projects/3e8af25034e24c7f81def4c24dee0e1f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:26.029594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d3ff-1bb8-4d65-8f1d-d43ed59153e6 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.030550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d3ff-1bb8-4d65-8f1d-d43ed59153e6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.031015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9d3ff-1bb8-4d65-8f1d-d43ed59153e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.044028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.045190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.045790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.046224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] PATH_INFO: `/v3/projects/6cf6cd6009e64579b709348a6d883698` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.048733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf6cd6009e64579b709348a6d883698)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.050994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.056329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-baa9d3ff-1bb8-4d65-8f1d-d43ed59153e6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:26.057494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-baa9d3ff-1bb8-4d65-8f1d-d43ed59153e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:26.068925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 871/1750] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:26.076508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.080383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.080383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.103801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:26.105133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:26.119147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 872/1751] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:26.121026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.138741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74978797-074b-4db2-9b8c-d057a65a2e9c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.143887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.144731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.145053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.145334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.146122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:26.146435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.148094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.166094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 873/1752] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:26.167175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.178351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f976d33-fd83-44b1-bd65-eaf7c363d4e5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.183735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.184510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.184805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.185212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.185915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.187814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.217562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf6cd6009e64579b709348a6d883698', 'request_id': 'req-ce1f52a4-73dc-4c5d-859e-33acff2a0228'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.224949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf6cd6009e64579b709348a6d883698', 'request_id': 'req-ce1f52a4-73dc-4c5d-859e-33acff2a0228'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.230526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf6cd6009e64579b709348a6d883698', 'request_id': 'req-ce1f52a4-73dc-4c5d-859e-33acff2a0228'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.295446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 874/1753] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:26.299968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.317496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] The token cache is being invalidate because project 6cf6cd6009e64579b709348a6d883698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:26.318126 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.319955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ce1f52a4-73dc-4c5d-859e-33acff2a0228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:26.323259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 880/1754] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:25 2022] DELETE /identity/v3/projects/6cf6cd6009e64579b709348a6d883698 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:26.332074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a5f80-abb2-4497-9eaf-ab76f8bd99f4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.332546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a5f80-abb2-4497-9eaf-ab76f8bd99f4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.333004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a5f80-abb2-4497-9eaf-ab76f8bd99f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.372027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-153a5f80-abb2-4497-9eaf-ab76f8bd99f4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:26.373252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-153a5f80-abb2-4497-9eaf-ab76f8bd99f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:26.401037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051450e-a22c-46d5-ba32-8b34c395b69a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.407983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.407983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.407983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.408322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.409327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.410859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.444938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 881/1755] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:26.453144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2d2d2-468d-472d-8009-23197632777d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.453519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2d2d2-468d-472d-8009-23197632777d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.454294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2d2d2-468d-472d-8009-23197632777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.478168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-34d2d2d2-468d-472d-8009-23197632777d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:26.479745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-34d2d2d2-468d-472d-8009-23197632777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:26.489537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 882/1756] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:26.494663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2d2d2-468d-472d-8009-23197632777d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.508950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 875/1757] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:26.509124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2d2d2-468d-472d-8009-23197632777d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.510030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.511803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:26.515237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.516061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.516411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.516786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.517579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:26.517984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.519687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.526684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0d58-0e07-4dd7-aad5-35a04bdb9016 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.537633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 883/1758] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:09:26.537927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.537927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.537927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.537927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.538336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.538562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.538952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.549436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 876/1759] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:26.554957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918578b4-16c4-43ce-877a-025e2a1af77c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.556040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.557982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.558970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.559266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.559549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.560313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.562387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.569864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12afd726-8e7e-426d-8e57-014746f07162 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.575966 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.576635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.576922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.577200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.577936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.579733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.591405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 877/1760] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:26.595573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.606505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6d82c-45b9-4544-a872-e6e4f1181e4b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.611380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60356c1d-315b-4b42-b2bc-f9c551719fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.616240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356c1d-315b-4b42-b2bc-f9c551719fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.616240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356c1d-315b-4b42-b2bc-f9c551719fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.616240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60356c1d-315b-4b42-b2bc-f9c551719fd2 admin admin] PATH_INFO: `/v3/projects/75e8912148634297823a6d7dcdd8142d/users/a4865c9ca19644bb8dab554e79f9969c/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.629124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60356c1d-315b-4b42-b2bc-f9c551719fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e8912148634297823a6d7dcdd8142d, user_id=a4865c9ca19644bb8dab554e79f9969c, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.632683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60356c1d-315b-4b42-b2bc-f9c551719fd2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.649215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 884/1761] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:26.651085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.714900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 878/1762] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:26 2022] PUT /identity/v3/projects/75e8912148634297823a6d7dcdd8142d/users/a4865c9ca19644bb8dab554e79f9969c/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:26.717807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.718099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.718388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.724874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f552a988-ee00-4031-9359-44c71023caf9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.748249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] MFA Rules not processed for user `a4865c9ca19644bb8dab554e79f9969c`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:26.749486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:26.801548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.802606 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.802606 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.803025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.804255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.805994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.830568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 879/1763] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:26.835747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.845972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d034ac5-8743-452b-9d6f-97df2cf35c04 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.851237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.851922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.852208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.852517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.857868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.857868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.913677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 885/1764] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:26.923619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.935109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f26f6-d503-4460-8a86-490a7949bc70 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:26.940549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:26.941473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:26.941761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:26.943011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:26.944312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:26.949952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:26.951222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 880/1765] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:26.955572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.963251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 886/1766] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:26.964197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:26.974544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd917a-eba3-4c2c-bff8-bd1b1c86c7b1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.023523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9e91-22b0-4fb3-844b-acc8838b9f38 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.029235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859a54-622f-484c-a992-e792237cf3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.029959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859a54-622f-484c-a992-e792237cf3cc admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.030247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859a54-622f-484c-a992-e792237cf3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.037636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859a54-622f-484c-a992-e792237cf3cc admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.037636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859a54-622f-484c-a992-e792237cf3cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.037636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859a54-622f-484c-a992-e792237cf3cc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.055683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.060541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.060541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.060541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.060541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.061142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.075870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 887/1767] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:27.077550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.089669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3cfbb-c5e3-4673-b0ad-86f02699d2c0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.094212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.095086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.095362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.095635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] PATH_INFO: `/v3/projects/eb2f198cea694e3ca32db4d1bee9dbbd/users/1e6eaeed01d940bb9dacadf59191a52b/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.117752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2f198cea694e3ca32db4d1bee9dbbd, user_id=1e6eaeed01d940bb9dacadf59191a52b, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.120639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.140159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 881/1768] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:26 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:27.144591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418f1e-37ed-4b37-b543-55f96f7ed79e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.146687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418f1e-37ed-4b37-b543-55f96f7ed79e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.146687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35418f1e-37ed-4b37-b543-55f96f7ed79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.180861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-35418f1e-37ed-4b37-b543-55f96f7ed79e None None] MFA Rules not processed for user `86206d7462644827a713e04a8a60c28b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:27.182303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-35418f1e-37ed-4b37-b543-55f96f7ed79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:27.202617 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 888/1769] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:27 2022] PUT /identity/v3/projects/eb2f198cea694e3ca32db4d1bee9dbbd/users/1e6eaeed01d940bb9dacadf59191a52b/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:27.214308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.312663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380160a-105a-4507-9e88-bb8b35828e51 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.318604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.319409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.319823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.320251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.321469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.323229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.345019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 882/1770] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:27.346622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.347048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.347434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.351276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 889/1771] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:27.364735 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.368327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:27.396392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] MFA Rules not processed for user `1e6eaeed01d940bb9dacadf59191a52b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:27.399115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:27.462871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e5d8b-0431-44c4-84a4-1a0342845f07 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.466799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.467457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.467738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.468464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.469889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:27.477902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 883/1772] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:27.477902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.488717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff930ab-436d-4969-904c-042274a588a7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.493913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.494890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.495249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.495530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] PATH_INFO: `/v3/projects/7e7415f8e5c040dca339cc7e0aa9f2b7/users/f4fe6eebfda94fba90aaffbbae927f80/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.513163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7415f8e5c040dca339cc7e0aa9f2b7, user_id=f4fe6eebfda94fba90aaffbbae927f80, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.515771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.533377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.534854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.544838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 890/1773] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:27.545715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.556707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885da54f-05c2-4734-bb16-a4d2c7da7825 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.561965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.562610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.562893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.563170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.564024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.565804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.586892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 884/1774] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:27 2022] PUT /identity/v3/projects/7e7415f8e5c040dca339cc7e0aa9f2b7/users/f4fe6eebfda94fba90aaffbbae927f80/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:27.590988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.652279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cda9e8-37d2-4ae9-93bc-619a3f404c8a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.657168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.657838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.658127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.658403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.659143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.662755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.666297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 891/1775] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:27 2022] POST /identity/v3/projects => generated 361 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:27.667046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.672661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 885/1776] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:27.676881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.687980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308936-be8f-494e-aaa3-8dea1093721c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.732828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e858-8f19-487c-b56c-ac49f0add28e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.737649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.738317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.738716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.738924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.740764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.742605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.757606 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fc145-d2b0-4487-af3f-fa62752bb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.759146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fc145-d2b0-4487-af3f-fa62752bb462 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.759605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fc145-d2b0-4487-af3f-fa62752bb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.760115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fc145-d2b0-4487-af3f-fa62752bb462 admin admin] PATH_INFO: `/v3/projects/7e7415f8e5c040dca339cc7e0aa9f2b7/users/f4fe6eebfda94fba90aaffbbae927f80/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.762498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fc145-d2b0-4487-af3f-fa62752bb462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7415f8e5c040dca339cc7e0aa9f2b7, user_id=f4fe6eebfda94fba90aaffbbae927f80, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.765546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fc145-d2b0-4487-af3f-fa62752bb462 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.777595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 886/1777] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:27 2022] PUT /identity/v3/projects/7e7415f8e5c040dca339cc7e0aa9f2b7/users/f4fe6eebfda94fba90aaffbbae927f80/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:27.794416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.794834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.795120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.824923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] MFA Rules not processed for user `f4fe6eebfda94fba90aaffbbae927f80`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:27.826152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:27.851722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 892/1778] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:27 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:27.852933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.862928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19495e64-f3df-4553-bdfa-2d2427931484 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.904872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 887/1779] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:27.917054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.918464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:27.937851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.938593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.938824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.939109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.940864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.941841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:27.958895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 893/1780] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:27.960144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:27.972495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514e136-ddde-4eba-9ab8-0dc47d0f7a10 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.978874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:27.979890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:27.980915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:27.980915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] PATH_INFO: `/v3/projects/7ef77859e8bd4cd6aed304140c610f78/users/4d00218707e641ed976676fad9ba38cc/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:27.992967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca291c-d901-442c-8af7-2ce8824ccbed None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:27.998230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef77859e8bd4cd6aed304140c610f78, user_id=4d00218707e641ed976676fad9ba38cc, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:27.999112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:28.000161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.000630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.001054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.001184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:28.017467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:28.020592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:28.032446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 888/1781] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:28.111589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 894/1782] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:27 2022] PUT /identity/v3/projects/7ef77859e8bd4cd6aed304140c610f78/users/4d00218707e641ed976676fad9ba38cc/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:28.115958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:28.126704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9b3cd-25a3-4a6e-9e40-2522da40a39b service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:28.168713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:28.223175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:28.228679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.228679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.228679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.228679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:28.228679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:28.242646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 889/1783] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:28.243875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:28.256546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0acc1-7d35-4dd0-8e32-735281b95f38 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:28.284263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0d9b6-4a88-42da-bee2-c1dbc68b7c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:28.285227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d9b6-4a88-42da-bee2-c1dbc68b7c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.285591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d9b6-4a88-42da-bee2-c1dbc68b7c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.285869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0d9b6-4a88-42da-bee2-c1dbc68b7c87 admin admin] PATH_INFO: `/v3/projects/7ef77859e8bd4cd6aed304140c610f78/users/4d00218707e641ed976676fad9ba38cc/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.291876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d9b6-4a88-42da-bee2-c1dbc68b7c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef77859e8bd4cd6aed304140c610f78, user_id=4d00218707e641ed976676fad9ba38cc, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:28.296739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0d9b6-4a88-42da-bee2-c1dbc68b7c87 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:28.308298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991da53-d916-42e4-9d9c-19b332ea173b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:28.315945 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 890/1784] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:28 2022] PUT /identity/v3/projects/7ef77859e8bd4cd6aed304140c610f78/users/4d00218707e641ed976676fad9ba38cc/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:28.324141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.324713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.331148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.388040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] MFA Rules not processed for user `4d00218707e641ed976676fad9ba38cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:28.389649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:28.436795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:28.440298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.440298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.440298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] PATH_INFO: `/v3/users/a4865c9ca19644bb8dab554e79f9969c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.440942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4865c9ca19644bb8dab554e79f9969c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:28.455640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:28.548444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 891/1785] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:28.558316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:28.650911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c2c8c-78f7-4932-9cbd-b304e10b8c7b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:28.655052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01390d-8596-4cb1-8f1c-cc883d90fc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:28.655750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01390d-8596-4cb1-8f1c-cc883d90fc1f service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.656100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01390d-8596-4cb1-8f1c-cc883d90fc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.656313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01390d-8596-4cb1-8f1c-cc883d90fc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.667566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01390d-8596-4cb1-8f1c-cc883d90fc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:28.669076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01390d-8596-4cb1-8f1c-cc883d90fc1f service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:28.687552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 892/1786] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:28.758119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4865c9ca19644bb8dab554e79f9969c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:28.759175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4865c9ca19644bb8dab554e79f9969c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:28.775704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4865c9ca19644bb8dab554e79f9969c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:28.793829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4865c9ca19644bb8dab554e79f9969c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:28.794900 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4865c9ca19644bb8dab554e79f9969c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:28.918486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 895/1787] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:28 2022] DELETE /identity/v3/users/a4865c9ca19644bb8dab554e79f9969c => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:28.923347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:28.923918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:28.924353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:28.944813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:28.946325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:29.011940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:29.013785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:29.057160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 893/1788] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:29.064061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:29.065704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:29.162011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e7918-5fbf-4778-983e-8439e80b1b85 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:29.196373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:29.197476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:29.197948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:29.198414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:29.217274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:29.267585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc96ba-f342-42dd-8502-2e19390f9fac None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:29.291722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:29.295899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:29.296583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:29.297047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:29.335772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:29.338750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:29.421022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 894/1789] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:29.422936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:29.426004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:29.450802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 896/1790] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:29.764095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:29.765852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:29.779991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97dbbb-4b4a-4901-9bd2-9203e1eed561 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:29.791103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:29.791946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:29.792551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:29.798125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:29.809993 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:29.905700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:29.909649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:29.930190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 895/1791] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:31.244148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:31.245662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:31.345934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b02f4-b9f3-4e78-964d-fcb6884bc7be service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:31.370028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:31.372520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:31.372771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:31.373067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] PATH_INFO: `/v3/projects/75e8912148634297823a6d7dcdd8142d` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:31.377389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e8912148634297823a6d7dcdd8142d)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:31.393514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:31.635861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e8912148634297823a6d7dcdd8142d', 'request_id': 'req-d9a9889d-7163-43c7-9832-91d6829761fc'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:31.658340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e8912148634297823a6d7dcdd8142d', 'request_id': 'req-d9a9889d-7163-43c7-9832-91d6829761fc'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:31.675667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e8912148634297823a6d7dcdd8142d', 'request_id': 'req-d9a9889d-7163-43c7-9832-91d6829761fc'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:31.930715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] The token cache is being invalidate because project 75e8912148634297823a6d7dcdd8142d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:31.932536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:31.935642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:31.944360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 897/1792] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:31 2022] DELETE /identity/v3/projects/75e8912148634297823a6d7dcdd8142d => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:31.951229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:32.021233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5241f5-fc08-4434-a16f-3c9fbbed857b service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:32.273926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:32.276705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:32.277953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:32.278755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] PATH_INFO: `/v3/users/f4fe6eebfda94fba90aaffbbae927f80` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:32.282834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4fe6eebfda94fba90aaffbbae927f80)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:32.289052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:32.625493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4fe6eebfda94fba90aaffbbae927f80'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:32.643607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4fe6eebfda94fba90aaffbbae927f80'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:32.691487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4fe6eebfda94fba90aaffbbae927f80'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:32.693294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4fe6eebfda94fba90aaffbbae927f80'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:32.694151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4d7e9a40-10b7-4f54-b4a8-458bd05a2922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4fe6eebfda94fba90aaffbbae927f80'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:32.810299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 896/1793] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:31 2022] DELETE /identity/v3/users/f4fe6eebfda94fba90aaffbbae927f80 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:33.808174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:33.811729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:33.838634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9889d-7163-43c7-9832-91d6829761fc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:34.086293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:34.087926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:34.088415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:34.088896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] PATH_INFO: `/v3/projects/7e7415f8e5c040dca339cc7e0aa9f2b7` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:34.101882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7415f8e5c040dca339cc7e0aa9f2b7)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:34.108121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:34.327316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7415f8e5c040dca339cc7e0aa9f2b7', 'request_id': 'req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:34.334946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7415f8e5c040dca339cc7e0aa9f2b7', 'request_id': 'req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:34.342145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7415f8e5c040dca339cc7e0aa9f2b7', 'request_id': 'req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:34.502018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] The token cache is being invalidate because project 7e7415f8e5c040dca339cc7e0aa9f2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:34.502312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:34.502971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7b2f5ee-b0ca-47bb-a5bb-362d507b735a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:34.504793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 898/1794] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:33 2022] DELETE /identity/v3/projects/7e7415f8e5c040dca339cc7e0aa9f2b7 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:34.511097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:34.511879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:34.512111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:34.543608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:34.545424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:34.650157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 897/1795] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:34.658062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:34.658361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:34.658644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:34.684543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:34.686199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:34.698577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 899/1796] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:34.703213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:34.722254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc798-f129-4365-a1a9-8ab59817cd8b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:34.728118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:34.728793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:34.729076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:34.729353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:34.730082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:34.730386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:34.732202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:34.749593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 898/1797] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:09:34.754884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:34.772622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1ab9-744c-4256-b7fe-c5dfa4f7400b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:34.780991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:34.783274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:34.783274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:34.783274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:34.784561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:34.789062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:34.910461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 900/1798] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:34 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:34.915417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:34.925654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46ff52-a36c-449a-95bc-0aafe6ce8aa8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:35.010991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:35.012780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.012780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.012780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.013233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:35.015665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:35.132353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 899/1799] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:34 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:35.137097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:35.148662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d5c3e-2e3d-49f4-bbed-eeb93c8a0f1b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:35.157459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:35.158145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.158431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.158743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.159486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:35.161287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:35.191612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 901/1800] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:35.194282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:35.205432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4d33-93fd-4d44-8bed-3a8857f4675b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:35.212746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c044fc5-b7eb-4a66-9f4e-bfd63e67dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:35.213886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c044fc5-b7eb-4a66-9f4e-bfd63e67dda1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.214233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c044fc5-b7eb-4a66-9f4e-bfd63e67dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.214638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c044fc5-b7eb-4a66-9f4e-bfd63e67dda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.215640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c044fc5-b7eb-4a66-9f4e-bfd63e67dda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:35.217302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c044fc5-b7eb-4a66-9f4e-bfd63e67dda1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:35.228578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 900/1801] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:35.233969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:35.254108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c046090-e792-4aa8-b02d-48460a6ef760 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:35.263190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:35.264149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.269792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.269792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] PATH_INFO: `/v3/projects/e4580eeca21f4c57b8995172549aa16e/users/abfd2c48fc8f4f198706ee12bc97ccf1/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.283940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4580eeca21f4c57b8995172549aa16e, user_id=abfd2c48fc8f4f198706ee12bc97ccf1, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:35.287383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:35.393010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 902/1802] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:35 2022] PUT /identity/v3/projects/e4580eeca21f4c57b8995172549aa16e/users/abfd2c48fc8f4f198706ee12bc97ccf1/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:35.409155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.410196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.412589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.481459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] MFA Rules not processed for user `abfd2c48fc8f4f198706ee12bc97ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:35.481459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:35.573497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 901/1803] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:35.584432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:35.683860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec64853-5322-48b8-a376-5fe9b406c6c3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:35.690937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:35.694976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.694976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.694976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.694976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:35.695526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:35.792569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:35.794526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:35.804518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 903/1804] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:35 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:35.811953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:35.821654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417de8ae-4550-46bf-989f-b185f87f4fca None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:35.927043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:35.928078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:35.928972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:35.929341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] PATH_INFO: `/v3/users/1e6eaeed01d940bb9dacadf59191a52b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:35.931152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e6eaeed01d940bb9dacadf59191a52b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:35.933303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.010320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2860260-da0b-41c5-b631-253d611f71c4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.010320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.010320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.010320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.011625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.011625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.011625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.256832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 904/1805] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:35 2022] POST /identity/v3/users => generated 303 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:36.261636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:36.272110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de1cd1-eaed-425d-85ee-b0b8d6c0e430 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.279294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.279934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.280515 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.280683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.281809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.283560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.296876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 905/1806] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:36.299430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:36.316021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc409f-ce73-4075-957f-e8d74c3719ce admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.324991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.326381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.327201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.327668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] PATH_INFO: `/v3/projects/0150b1824fd04fb8a82f21f78b12d618/users/ba0fb092810945a589f1d7eee90c2150/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.365204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0150b1824fd04fb8a82f21f78b12d618, user_id=ba0fb092810945a589f1d7eee90c2150, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.373090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.391241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e6eaeed01d940bb9dacadf59191a52b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:36.407339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e6eaeed01d940bb9dacadf59191a52b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:36.425757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e6eaeed01d940bb9dacadf59191a52b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:36.426604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e6eaeed01d940bb9dacadf59191a52b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:36.428165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5d182227-5551-4ca6-b602-5da74b58b531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e6eaeed01d940bb9dacadf59191a52b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:36.448255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 906/1807] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:36 2022] PUT /identity/v3/projects/0150b1824fd04fb8a82f21f78b12d618/users/ba0fb092810945a589f1d7eee90c2150/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:36.452674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:36.454653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:36.518235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 902/1808] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:35 2022] DELETE /identity/v3/users/1e6eaeed01d940bb9dacadf59191a52b => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:36.525270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.525270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.525270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.539827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85fd77-e1c6-4fba-93db-5102cb619e36 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.564815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:36.567334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:36.608447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.609144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.609424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.609713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.611574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.612252 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.625282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 907/1809] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:36.629660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:36.642771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121592d-bf45-45a9-93b7-ab87adeb7f10 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.648644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97710562-7b5f-43cc-82f2-3c5a2a9df895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.650052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710562-7b5f-43cc-82f2-3c5a2a9df895 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.652014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710562-7b5f-43cc-82f2-3c5a2a9df895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.652361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710562-7b5f-43cc-82f2-3c5a2a9df895 admin admin] PATH_INFO: `/v3/projects/0150b1824fd04fb8a82f21f78b12d618/users/ba0fb092810945a589f1d7eee90c2150/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.655972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97710562-7b5f-43cc-82f2-3c5a2a9df895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0150b1824fd04fb8a82f21f78b12d618, user_id=ba0fb092810945a589f1d7eee90c2150, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.663858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97710562-7b5f-43cc-82f2-3c5a2a9df895 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.679340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 908/1810] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:36 2022] PUT /identity/v3/projects/0150b1824fd04fb8a82f21f78b12d618/users/ba0fb092810945a589f1d7eee90c2150/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:36.696341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.697187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.698702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.709024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 903/1811] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:36.716656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:36.721730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:36.768015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] MFA Rules not processed for user `ba0fb092810945a589f1d7eee90c2150`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:36.769692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:36.823873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021e96f-007f-4abf-8914-575aecafb87a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.853602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 909/1812] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:36.854489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:36.860208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:36.905040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.905700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.905983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.906290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.945949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f445e12-75a9-4a3a-999e-4edd0daab03a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:36.951216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:36.952136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:36.952419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:36.952699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] PATH_INFO: `/v3/users/29ad859990864e74b410a0a844bf2c90` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:36.954185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ad859990864e74b410a0a844bf2c90)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.956910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:36.986651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:36.988167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:37.003880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 904/1813] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:37.005735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:37.007505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.181954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a637b07-15dc-4b86-b946-0949bef9c288 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:37.190245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f230c6-55b6-4b61-9b7b-68c8b42168db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:37.191616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f230c6-55b6-4b61-9b7b-68c8b42168db service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:37.192001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f230c6-55b6-4b61-9b7b-68c8b42168db service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:37.194028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f230c6-55b6-4b61-9b7b-68c8b42168db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:37.221021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f230c6-55b6-4b61-9b7b-68c8b42168db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:37.225726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f230c6-55b6-4b61-9b7b-68c8b42168db service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:37.249738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 905/1814] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:37.261981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ad859990864e74b410a0a844bf2c90'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:37.265364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ad859990864e74b410a0a844bf2c90'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:37.289813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ad859990864e74b410a0a844bf2c90'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:37.324641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ad859990864e74b410a0a844bf2c90'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:37.327025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ad859990864e74b410a0a844bf2c90'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:37.485896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 910/1815] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:36 2022] DELETE /identity/v3/users/29ad859990864e74b410a0a844bf2c90 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:37.492206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:37.492871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:37.493442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:37.526113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:37.527445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.582350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:37.584656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.604653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 906/1816] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:37.617118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:37.625173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.718468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4fe1d-3a27-4651-963f-d71ab5cfe50c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:37.725488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:37.728690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:37.729179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:37.729650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:37.732710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.749957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1eae1-2594-4ba2-b084-0f5ca839268d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:37.758186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:37.759033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:37.759504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:37.760005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:37.785325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:37.789430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:37.839790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 907/1817] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:37.841188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:37.845764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:37.847948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:37.855965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.861464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 911/1818] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:37.884217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:37.887300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:37.906183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38de47-b843-4ac4-942d-698e9a07bdf9 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:37.911872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb745f2c-534b-45bd-be22-a017742a4076 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:37.920435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:37.921771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:37.922683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:37.923541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] PATH_INFO: `/v3/projects/eb2f198cea694e3ca32db4d1bee9dbbd` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:37.926723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2f198cea694e3ca32db4d1bee9dbbd)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:37.927559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:37.929688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:37.930992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:37.931360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:37.931716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] PATH_INFO: `/v3/users/5234c71fd42b4b819c97a202deeeb4db` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:37.936115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5234c71fd42b4b819c97a202deeeb4db)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:37.939494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:38.190269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2f198cea694e3ca32db4d1bee9dbbd', 'request_id': 'req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.199731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5234c71fd42b4b819c97a202deeeb4db'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.212461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5234c71fd42b4b819c97a202deeeb4db'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.217554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2f198cea694e3ca32db4d1bee9dbbd', 'request_id': 'req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.241823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5234c71fd42b4b819c97a202deeeb4db'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.269101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5234c71fd42b4b819c97a202deeeb4db'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.271868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-837d37dd-3970-404c-a789-81c704f4739f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5234c71fd42b4b819c97a202deeeb4db'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.367206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2f198cea694e3ca32db4d1bee9dbbd', 'request_id': 'req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.384996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] The token cache is being invalidate because project eb2f198cea694e3ca32db4d1bee9dbbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:38.385294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.386071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:38.388015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 908/1819] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:37 2022] DELETE /identity/v3/projects/eb2f198cea694e3ca32db4d1bee9dbbd => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:38.395447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:38.397524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:38.542049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4a5d1-8083-419d-9cdd-ce6458da3d38 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:38.546922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:38.547819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:38.548134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:38.548411 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] PATH_INFO: `/v3/users/4d00218707e641ed976676fad9ba38cc` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:38.549748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d00218707e641ed976676fad9ba38cc)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:38.552969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:39.516757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 912/1820] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:37 2022] DELETE /identity/v3/users/5234c71fd42b4b819c97a202deeeb4db => generated 0 bytes in 1633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:39.525417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:39.525717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:39.525998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:39.544820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:39.545953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:39.621380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 913/1821] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:39.621380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:39.621380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:39.633675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ab578-78d3-4b57-8ca4-118a5280ff82 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:39.638805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:39.639679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:39.639996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:39.640276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] PATH_INFO: `/v3/projects/e5a7e30aa1db4b17bbf5314f6271a74c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:39.641663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a7e30aa1db4b17bbf5314f6271a74c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:39.643507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:39.687352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d00218707e641ed976676fad9ba38cc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.698518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d00218707e641ed976676fad9ba38cc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.723176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d00218707e641ed976676fad9ba38cc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.724531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d00218707e641ed976676fad9ba38cc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.725717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d00218707e641ed976676fad9ba38cc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.850989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a7e30aa1db4b17bbf5314f6271a74c', 'request_id': 'req-43cefb01-6d88-498c-ac75-037d6986050b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.861283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a7e30aa1db4b17bbf5314f6271a74c', 'request_id': 'req-43cefb01-6d88-498c-ac75-037d6986050b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.868893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a7e30aa1db4b17bbf5314f6271a74c', 'request_id': 'req-43cefb01-6d88-498c-ac75-037d6986050b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.870517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 909/1822] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:38 2022] DELETE /identity/v3/users/4d00218707e641ed976676fad9ba38cc => generated 0 bytes in 1478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:39.872813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:39.876869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:39.959423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e416e-55ff-4cc7-97df-2cea78ab349a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:39.964590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] The token cache is being invalidate because project e5a7e30aa1db4b17bbf5314f6271a74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:39.965095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:39.965228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.966219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:39.966404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:39.967052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:39.967519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:39.972921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 914/1823] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:39 2022] DELETE /identity/v3/projects/e5a7e30aa1db4b17bbf5314f6271a74c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:39.974433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:39.976306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:39.978036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:40.087908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cefb01-6d88-498c-ac75-037d6986050b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:40.167375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:40.169118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:40.196230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 910/1824] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:40.200394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:40.201363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:40.201650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:40.201935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] PATH_INFO: `/v3/users/205d175de8714fb588e3bfb1c4ed3556` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:40.203822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=205d175de8714fb588e3bfb1c4ed3556)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:40.205836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:40.542453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:40.544057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:40.578886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5472afc-718c-47ff-ac21-947210285992 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:40.595377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205d175de8714fb588e3bfb1c4ed3556'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.596125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205d175de8714fb588e3bfb1c4ed3556'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.600062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:40.605050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:40.605695 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:40.606440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] PATH_INFO: `/v3/projects/7ef77859e8bd4cd6aed304140c610f78` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:40.606556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205d175de8714fb588e3bfb1c4ed3556'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.617275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef77859e8bd4cd6aed304140c610f78)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:40.623194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:40.625190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205d175de8714fb588e3bfb1c4ed3556'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.626068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-00a7c8e6-0aa0-4f1f-897c-cc2effe500dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205d175de8714fb588e3bfb1c4ed3556'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.716424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 915/1825] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:39 2022] DELETE /identity/v3/users/205d175de8714fb588e3bfb1c4ed3556 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:40.717796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510dd7-231a-457c-883e-83943d5b3436 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:40.718086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510dd7-231a-457c-883e-83943d5b3436 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:40.718368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89510dd7-231a-457c-883e-83943d5b3436 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:40.720215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 916/1826] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:09:40.730111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:40.731673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:40.732122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:40.769293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:40.771235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:40.851492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef77859e8bd4cd6aed304140c610f78', 'request_id': 'req-13beaf2d-25dc-420a-9ae8-b572a44050fc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.862962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef77859e8bd4cd6aed304140c610f78', 'request_id': 'req-13beaf2d-25dc-420a-9ae8-b572a44050fc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.902490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 917/1827] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:40.903971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:40.905713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:40.950746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef77859e8bd4cd6aed304140c610f78', 'request_id': 'req-13beaf2d-25dc-420a-9ae8-b572a44050fc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.964978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] The token cache is being invalidate because project 7ef77859e8bd4cd6aed304140c610f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:40.965475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.966705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:40.969195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 911/1828] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:40 2022] DELETE /identity/v3/projects/7ef77859e8bd4cd6aed304140c610f78 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:40.970727 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:40.973129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:40.995760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd645-46d9-4fd3-95b6-1fb379c545a4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:41.055104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beaf2d-25dc-420a-9ae8-b572a44050fc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:41.064887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:41.065866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.066157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.066430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] PATH_INFO: `/v3/projects/4185e17a66f0447a8f1a63763e74dbd3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.073012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4185e17a66f0447a8f1a63763e74dbd3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:41.073012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:41.073356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:41.074334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.074627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.074908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.080143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:41.118149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:41.120126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ddf05-ea07-4a7e-b7a8-56f8d2b2cd9c service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:41.148385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 912/1829] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:41.152674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e7c6-a342-4de1-b6b9-cbee2672d414 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.153447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e7c6-a342-4de1-b6b9-cbee2672d414 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.153447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e7c6-a342-4de1-b6b9-cbee2672d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.227773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d4f4e7c6-a342-4de1-b6b9-cbee2672d414 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:41.229968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4185e17a66f0447a8f1a63763e74dbd3', 'request_id': 'req-46e8124b-5524-46ba-9791-60c643a525ff'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.231592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d4f4e7c6-a342-4de1-b6b9-cbee2672d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:41.252823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4185e17a66f0447a8f1a63763e74dbd3', 'request_id': 'req-46e8124b-5524-46ba-9791-60c643a525ff'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.289185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4185e17a66f0447a8f1a63763e74dbd3', 'request_id': 'req-46e8124b-5524-46ba-9791-60c643a525ff'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.396085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 913/1830] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:41.404087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.404432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.404662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.427898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:41.429199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:41.437307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 914/1831] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:41.441510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:41.450958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b717a-9292-4ab5-9491-9982573fc8c7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:41.455716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:41.456395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.456683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.456960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.458479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:41.458789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:41.460413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:41.475602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] The token cache is being invalidate because project 4185e17a66f0447a8f1a63763e74dbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:41.476078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.476763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.482712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 918/1832] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:40 2022] DELETE /identity/v3/projects/4185e17a66f0447a8f1a63763e74dbd3 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:41.483475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:41.486574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:41.490706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 915/1833] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:41.491359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:41.499366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:41.508783 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8124b-5524-46ba-9791-60c643a525ff admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:41.514273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae8141-a6c4-4991-abd6-f3cbf78bdadd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:41.514698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:41.515575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.515919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.516176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] PATH_INFO: `/v3/projects/f0b54f2d3b8d490a83675c6e4926aba4` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.517494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b54f2d3b8d490a83675c6e4926aba4)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:41.519909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:41.522776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:41.523659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.524001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.524351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] PATH_INFO: `/v3/users/32894e880c1d43289131f7211535644b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.525650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32894e880c1d43289131f7211535644b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:41.527684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:41.735476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32894e880c1d43289131f7211535644b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.753347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32894e880c1d43289131f7211535644b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.764958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b54f2d3b8d490a83675c6e4926aba4', 'request_id': 'req-29669e74-4abd-4286-82b6-b762e239c938'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.780174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32894e880c1d43289131f7211535644b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.782023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32894e880c1d43289131f7211535644b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.784236 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32894e880c1d43289131f7211535644b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.789953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b54f2d3b8d490a83675c6e4926aba4', 'request_id': 'req-29669e74-4abd-4286-82b6-b762e239c938'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.796413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b54f2d3b8d490a83675c6e4926aba4', 'request_id': 'req-29669e74-4abd-4286-82b6-b762e239c938'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.871731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 916/1834] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:41 2022] DELETE /identity/v3/users/32894e880c1d43289131f7211535644b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:41.872646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:41.876682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:41.973767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] The token cache is being invalidate because project f0b54f2d3b8d490a83675c6e4926aba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:41.974230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.974748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6d5c1-ea6f-4b59-ad1b-8e9b672db618 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:41.975278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-29669e74-4abd-4286-82b6-b762e239c938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:41.978173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 919/1835] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:41 2022] DELETE /identity/v3/projects/f0b54f2d3b8d490a83675c6e4926aba4 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:41.980403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:41.981086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.981377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.982097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.982814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:41.983575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5170f-2c7d-4166-95fe-373450cace8c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:41.983983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5170f-2c7d-4166-95fe-373450cace8c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:41.984806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5170f-2c7d-4166-95fe-373450cace8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:41.984978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.009868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3ce5170f-2c7d-4166-95fe-373450cace8c None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:42.011689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3ce5170f-2c7d-4166-95fe-373450cace8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:42.021558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 920/1836] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:42.030679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.030848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.031080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.057351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:42.058594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:42.068447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 921/1837] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:42.072991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.099951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4e51a-c051-4db5-b4ee-c72bddee06ae None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.107321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.108637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.108637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.108960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.109633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:42.110006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.113341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.125677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 922/1838] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:42.133055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.150718 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 917/1839] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:41 2022] POST /identity/v3/projects => generated 385 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:42.153159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.155001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a0e2d-576a-48f5-a9ec-cbff091dd919 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.158679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:42.253924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.258071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.263440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.263980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.268222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.277778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1415d-3df7-43dd-b4ab-79b46e6abe91 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.278308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.304933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.305889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.306399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.306863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.307757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.315033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.453038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 918/1840] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:42 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:42.457412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.470653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21db7c-d704-40f3-8fe7-ec4c0482f07f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.477318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.478035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.478359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.478637 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.479525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.493308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 923/1841] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:42 2022] POST /identity/v3/projects => generated 385 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:42.497189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.498021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.531897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 919/1842] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:42.541298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.571714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8327126-1ff5-40c6-b4db-d6e013016444 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.655324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78365a1-ddfa-42fb-afc0-1695bbaa59ea admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.669335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.669335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.669335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.669335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.669882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.669882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.673008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.673677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.673873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.674543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.677006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.679019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.690382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 920/1843] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:42.691677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.702805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:42.721877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdf458-e806-4f75-ac24-28ee994641f4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.731274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.732371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.732527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.732971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] PATH_INFO: `/v3/projects/1cee12ff4ae24906b9712b5a944c8a05` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.742309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cee12ff4ae24906b9712b5a944c8a05)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.744476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.822485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 924/1844] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:42 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:42.823329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.834006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc964061-b158-4d73-9630-310eda5f2fe8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:42.839082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:42.839991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:42.840311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:42.840640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] PATH_INFO: `/v3/projects/01d0162993834be088e2565cf466f9e5/users/0521aa67995c4fa1affa29c40a801014/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:42.855807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d0162993834be088e2565cf466f9e5, user_id=0521aa67995c4fa1affa29c40a801014, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:42.858669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:42.979809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 925/1845] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:42 2022] PUT /identity/v3/projects/01d0162993834be088e2565cf466f9e5/users/0521aa67995c4fa1affa29c40a801014/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:42.983042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:42.987851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cee12ff4ae24906b9712b5a944c8a05', 'request_id': 'req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:42.994202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cee12ff4ae24906b9712b5a944c8a05', 'request_id': 'req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:43.055020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788c5b-773f-44c2-b0ae-de28c0784fc8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.110291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cee12ff4ae24906b9712b5a944c8a05', 'request_id': 'req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:43.117955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cfc55-8aa7-4355-9871-c7128d389934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.118699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cfc55-8aa7-4355-9871-c7128d389934 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.119010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cfc55-8aa7-4355-9871-c7128d389934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.119286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cfc55-8aa7-4355-9871-c7128d389934 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.120063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cfc55-8aa7-4355-9871-c7128d389934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.121766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cfc55-8aa7-4355-9871-c7128d389934 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.130745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] The token cache is being invalidate because project 1cee12ff4ae24906b9712b5a944c8a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:43.130745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:43.130745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3f44f982-0f06-4d90-be8d-eb5b6f21c45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:43.130745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 921/1846] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:42 2022] DELETE /identity/v3/projects/1cee12ff4ae24906b9712b5a944c8a05 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:43.132085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.132435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.132777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.135527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 926/1847] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:43.136943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da109-32af-439a-b27c-324b19865672 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.137237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da109-32af-439a-b27c-324b19865672 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.137519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da109-32af-439a-b27c-324b19865672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.157172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9f2da109-32af-439a-b27c-324b19865672 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:43.158595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9f2da109-32af-439a-b27c-324b19865672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:43.161504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] MFA Rules not processed for user `0521aa67995c4fa1affa29c40a801014`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:43.162787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:43.169319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 927/1848] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:43.170175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da109-32af-439a-b27c-324b19865672 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.172025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9f2da109-32af-439a-b27c-324b19865672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:43.184822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da109-32af-439a-b27c-324b19865672 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.190831 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ea92c-f28c-42d0-891d-ea6f06726a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.191511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea92c-f28c-42d0-891d-ea6f06726a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.191801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea92c-f28c-42d0-891d-ea6f06726a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.192624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea92c-f28c-42d0-891d-ea6f06726a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.193444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ea92c-f28c-42d0-891d-ea6f06726a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.195058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ea92c-f28c-42d0-891d-ea6f06726a60 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.206226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 928/1849] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:43.208435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.208732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.212412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.235809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:43.237344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:43.251130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 929/1850] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:43.251130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.264661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424a9c8-b7d7-4a6c-aba2-88e068247f99 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.271084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.272249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.272604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.275923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] PATH_INFO: `/v3/projects/ade9aaa145484c269895565c82d09745/users/1f192f85f465450a9b9ff87d16255826/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.276089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 922/1851] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:43.276089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.287564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082bbe4c-a2c7-4bf0-99ce-3b87941b0989 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.294081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.294211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade9aaa145484c269895565c82d09745, user_id=1f192f85f465450a9b9ff87d16255826, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.294293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.294293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.294293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.294502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:43.294778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.295483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.296484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.320164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 923/1852] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:43.320164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.320164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:43.333879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bae94-3714-431c-8e58-1445624102dc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.338987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ec27-db83-4ed4-92f0-2171e2ccbd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.339655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ec27-db83-4ed4-92f0-2171e2ccbd38 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.339976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ec27-db83-4ed4-92f0-2171e2ccbd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.340258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ec27-db83-4ed4-92f0-2171e2ccbd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.341012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ec27-db83-4ed4-92f0-2171e2ccbd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.343193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ec27-db83-4ed4-92f0-2171e2ccbd38 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.404491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 930/1853] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:43 2022] PUT /identity/v3/projects/ade9aaa145484c269895565c82d09745/users/1f192f85f465450a9b9ff87d16255826/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:43.406402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.445916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 924/1854] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:43.447448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.447749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.448080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.484596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] MFA Rules not processed for user `1f192f85f465450a9b9ff87d16255826`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:43.485361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b8fd-bdbc-4173-ba5c-7c390e3b1e84 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.485880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:43.563322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.564103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.564396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.564680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.565753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.568895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.571826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 925/1855] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:43.572733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.588875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83af7d-fdc7-42fc-b410-135a45330e3b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.595158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.596955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.596955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.596955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.597639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.600573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.720557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 931/1856] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/projects => generated 377 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:43.724192 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.729192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 926/1857] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:43.733122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:43.757133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e83eb-390f-4ce3-aa19-f9b6bbcf95b1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.832164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8ae3c-42fd-4a2e-818d-55d1e11aa56d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:43.857987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.858684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.858982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.859255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.860017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.862000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:43.898853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:43.924104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:43.926625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:43.926625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:43.926927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:43.929544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.050669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 932/1858] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/projects => generated 387 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:44.053351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.078224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 927/1859] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:43 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:44.078224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.090103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d0b70-6818-47a7-8147-d59f19fbdd6b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.142506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab1c5b-7fe6-4b30-b490-0d58a5febd24 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.151241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.152156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.152462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.152818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.153717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.155668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.175056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 933/1860] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:44.177557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.194449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396eba1-ad41-4b59-beee-e41bd58d77e5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.196383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.197091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.197382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.197656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.198363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.200402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.204465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.205239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.206141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.206141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.206594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.209295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.220296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 934/1861] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:44.221436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.231501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e998108-ec63-4319-bada-9b31f1973dcf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.236975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.237875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.238185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.238468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] PATH_INFO: `/v3/projects/d2a9df64d9204060982ab4973fc96c75/users/7f0ad3af97dc4f40a3ad5a44934ae019/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.256571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a9df64d9204060982ab4973fc96c75, user_id=7f0ad3af97dc4f40a3ad5a44934ae019, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.259356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.345945 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 928/1862] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:44 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:44.347178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.364357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16314a-f906-45f7-88bb-ac84f7caf187 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.370247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.370938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.371228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.371657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.372614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.375317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.390385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 929/1863] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:44.390385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.405153 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e8dc5-a452-49d7-8cf4-638d4c6d60b8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.410291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.412411 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.412862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.413196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.414832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.416762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.432384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 930/1864] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:44.433649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.438338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 935/1865] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:44 2022] PUT /identity/v3/projects/d2a9df64d9204060982ab4973fc96c75/users/7f0ad3af97dc4f40a3ad5a44934ae019/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:44.445278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.446572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806c69-5c13-4c7b-83a9-ddfe54966071 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.525428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.526335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.526762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.527051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] PATH_INFO: `/v3/projects/0f9782f3ede64b229c3a953c0c4b4d99/users/24ddca6ff59742f991cec1707645ed29/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.541729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17ae48-9e49-4a38-a0d7-2c393b18292d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.545186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9782f3ede64b229c3a953c0c4b4d99, user_id=24ddca6ff59742f991cec1707645ed29, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.548340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a630-2ef1-4a9f-9b47-83b77b4b38f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.548605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.549232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a630-2ef1-4a9f-9b47-83b77b4b38f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.549522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a630-2ef1-4a9f-9b47-83b77b4b38f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.549803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a630-2ef1-4a9f-9b47-83b77b4b38f8 admin admin] PATH_INFO: `/v3/projects/a1fbb340181f424eaa6f81caf5cc7d54/users/a9e595462c254db89b286fc4b97d7d77/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.569321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a630-2ef1-4a9f-9b47-83b77b4b38f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fbb340181f424eaa6f81caf5cc7d54, user_id=a9e595462c254db89b286fc4b97d7d77, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.572204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a630-2ef1-4a9f-9b47-83b77b4b38f8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.630744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 931/1866] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:44 2022] PUT /identity/v3/projects/0f9782f3ede64b229c3a953c0c4b4d99/users/24ddca6ff59742f991cec1707645ed29/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:44.631655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.677989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 936/1867] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:44 2022] PUT /identity/v3/projects/a1fbb340181f424eaa6f81caf5cc7d54/users/a9e595462c254db89b286fc4b97d7d77/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:44.679285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.679579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.679869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.708750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] MFA Rules not processed for user `24ddca6ff59742f991cec1707645ed29`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:44.710141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:44.742261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f7f7d-cf90-4ec9-9f2b-735b7b4df355 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.781889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 937/1868] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:44.785789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.804585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.805298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.805626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.805916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.806678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.808543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.819709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 932/1869] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:44.820640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.830827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f0e31-70d8-4058-90c8-d6caaac0c6b1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.837992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a961154-ac8a-4cb2-9ab9-a90eb9be8262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.838669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a961154-ac8a-4cb2-9ab9-a90eb9be8262 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.838943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a961154-ac8a-4cb2-9ab9-a90eb9be8262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.839225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a961154-ac8a-4cb2-9ab9-a90eb9be8262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.839963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a961154-ac8a-4cb2-9ab9-a90eb9be8262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.842344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a961154-ac8a-4cb2-9ab9-a90eb9be8262 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.856784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b4ac-c9e8-4284-b2a6-5520c081bd66 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.861562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.862245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.862540 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.862830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.865175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.866161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.878106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 938/1870] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:44.878925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.893916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2547966-6fd8-4227-ad5d-5c1b954afe21 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:44.899611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:44.900723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.901069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.901377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] PATH_INFO: `/v3/projects/d2a9df64d9204060982ab4973fc96c75/users/7f0ad3af97dc4f40a3ad5a44934ae019/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.903639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a9df64d9204060982ab4973fc96c75, user_id=7f0ad3af97dc4f40a3ad5a44934ae019, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:44.906411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:44.918879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 939/1871] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:44 2022] PUT /identity/v3/projects/d2a9df64d9204060982ab4973fc96c75/users/7f0ad3af97dc4f40a3ad5a44934ae019/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:44.919771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:44.994351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 933/1872] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:44.996017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552071c6-c7f5-45c5-8b48-a85e839a79a1 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:44.996315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552071c6-c7f5-45c5-8b48-a85e839a79a1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:44.996599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552071c6-c7f5-45c5-8b48-a85e839a79a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:44.996960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c4c49-faca-41d6-b08a-b2d5abdea6a5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.041899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-552071c6-c7f5-45c5-8b48-a85e839a79a1 None None] MFA Rules not processed for user `7f0ad3af97dc4f40a3ad5a44934ae019`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:45.044378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-552071c6-c7f5-45c5-8b48-a85e839a79a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.073040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.074877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.075565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.076091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] PATH_INFO: `/v3/projects/a1fbb340181f424eaa6f81caf5cc7d54/users/a9e595462c254db89b286fc4b97d7d77/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.080019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fbb340181f424eaa6f81caf5cc7d54, user_id=a9e595462c254db89b286fc4b97d7d77, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.085435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.104882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 940/1873] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:44 2022] PUT /identity/v3/projects/a1fbb340181f424eaa6f81caf5cc7d54/users/a9e595462c254db89b286fc4b97d7d77/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:45.106059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.190185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 934/1874] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:45.191689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.192179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.192525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.228254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] MFA Rules not processed for user `a9e595462c254db89b286fc4b97d7d77`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:45.229648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.239630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b381-701e-436b-b4a6-a10f711bcb98 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.248446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.249395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.249715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.249930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.252186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.254407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.322373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 935/1875] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:45.323289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.324686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.339697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbf16a-0f37-4eb3-a5da-5311b984e164 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.344957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.345851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.346135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.346415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] PATH_INFO: `/v3/users/abfd2c48fc8f4f198706ee12bc97ccf1` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.347667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfd2c48fc8f4f198706ee12bc97ccf1)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.350537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.381834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 941/1876] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:45 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:45.382891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.387437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.475333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cac04-5f78-41dc-b42c-bff698e7990e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.479041 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.479686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.480005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.480283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.517965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfd2c48fc8f4f198706ee12bc97ccf1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:45.525447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfd2c48fc8f4f198706ee12bc97ccf1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:45.539961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfd2c48fc8f4f198706ee12bc97ccf1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:45.540901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfd2c48fc8f4f198706ee12bc97ccf1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:45.542357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfd2c48fc8f4f198706ee12bc97ccf1'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:45.551572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.553140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.564759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 942/1877] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:45.565719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.577742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ade0b-c0e3-4963-834c-cf7d5ec727df service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.584141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.584884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.585171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.585481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.586267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.587955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.599667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 943/1878] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:45.600713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.602487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.615120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9fac4-d442-483b-8991-db6685e97b76 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.621699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 936/1879] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:45 2022] DELETE /identity/v3/users/abfd2c48fc8f4f198706ee12bc97ccf1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:45.624192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.624192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.667995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.668707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.668993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.669295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.671153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.699206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b336b-c27a-4791-ae2b-7df2944293a5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.704400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.705425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.705772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.706112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] PATH_INFO: `/v3/projects/489fe59c183d448c998a1e20c1fccb72/users/97ea3942931643a58c5fc0a5fa9fbaf7/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.728669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489fe59c183d448c998a1e20c1fccb72, user_id=97ea3942931643a58c5fc0a5fa9fbaf7, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.728669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.743388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.745582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb1d50-2757-49fc-8a4f-65302ba9f4bf service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.757829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 944/1880] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:45.759103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.759403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.759687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.778770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:45.780052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.806668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 945/1881] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:45.807654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.812016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.832995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 937/1882] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:45 2022] PUT /identity/v3/projects/489fe59c183d448c998a1e20c1fccb72/users/97ea3942931643a58c5fc0a5fa9fbaf7/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:45.834337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.837732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353301b-ed94-40ee-b5e4-9d0d8c9319d1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.837885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:45.904887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.906205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.906205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.906375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] PATH_INFO: `/v3/users/1f192f85f465450a9b9ff87d16255826` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.907554 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f192f85f465450a9b9ff87d16255826)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.909546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.920117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007edc3-493a-45aa-830a-938e39577b61 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.924076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.924878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.925169 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.933214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.936208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.937708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.948619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 938/1883] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:45.949530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:45.960306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24717-1da4-4547-a4d3-7f1b9f7effe9 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:45.972521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:45.973468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:45.973947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:45.974532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:45.975927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:45.978156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:45.992736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 939/1884] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:45.996725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:46.009673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e86670-065c-44da-a868-3b647b0dd798 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:46.016911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b7b50-f88e-4e5a-b535-cefa10a58cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:46.019791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7b50-f88e-4e5a-b535-cefa10a58cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:46.020569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7b50-f88e-4e5a-b535-cefa10a58cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:46.021895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b7b50-f88e-4e5a-b535-cefa10a58cf5 admin admin] PATH_INFO: `/v3/projects/489fe59c183d448c998a1e20c1fccb72/users/97ea3942931643a58c5fc0a5fa9fbaf7/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:46.026928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7b50-f88e-4e5a-b535-cefa10a58cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489fe59c183d448c998a1e20c1fccb72, user_id=97ea3942931643a58c5fc0a5fa9fbaf7, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:46.033772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b7b50-f88e-4e5a-b535-cefa10a58cf5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:46.056435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 940/1885] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:45 2022] PUT /identity/v3/projects/489fe59c183d448c998a1e20c1fccb72/users/97ea3942931643a58c5fc0a5fa9fbaf7/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:46.069019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:46.069019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:46.069325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:46.096681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] MFA Rules not processed for user `97ea3942931643a58c5fc0a5fa9fbaf7`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:46.097906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.201988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 941/1886] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:46.208263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f192f85f465450a9b9ff87d16255826'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.209261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f192f85f465450a9b9ff87d16255826'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.218976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f192f85f465450a9b9ff87d16255826'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.252836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f192f85f465450a9b9ff87d16255826'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.254238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b1b8cee0-263a-486d-8fd8-329cbac53f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f192f85f465450a9b9ff87d16255826'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.374653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:46.376133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.443307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 946/1887] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:45 2022] DELETE /identity/v3/users/1f192f85f465450a9b9ff87d16255826 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:46.448207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:46.448207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:46.452057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:46.496094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:46.498678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.502629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c02a-eb7e-48bd-bd14-d34ac73144ab None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:46.579344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:46.580961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:46.581867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:46.593071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:46.598902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.637099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 947/1888] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:46.638264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:46.649275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.668193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe370e91-c896-45bc-a5c0-f85ae7a3cc75 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:46.674156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:46.676038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:46.676758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:46.677438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] PATH_INFO: `/v3/projects/e4580eeca21f4c57b8995172549aa16e` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:46.679356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4580eeca21f4c57b8995172549aa16e)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:46.682625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:46.744587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:46.748693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:46.769307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 942/1889] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:46.772163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:46.775469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.878146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4580eeca21f4c57b8995172549aa16e', 'request_id': 'req-ccc5a544-f4cd-4240-b0f0-260a62f5e532'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.898723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4580eeca21f4c57b8995172549aa16e', 'request_id': 'req-ccc5a544-f4cd-4240-b0f0-260a62f5e532'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.901765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0bc8b-41be-44b6-bb75-9275e86de637 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:46.911919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4580eeca21f4c57b8995172549aa16e', 'request_id': 'req-ccc5a544-f4cd-4240-b0f0-260a62f5e532'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.975284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] The token cache is being invalidate because project e4580eeca21f4c57b8995172549aa16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:46.977841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.977841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:46.981708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 948/1890] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:46 2022] DELETE /identity/v3/projects/e4580eeca21f4c57b8995172549aa16e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:46.983568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:46.984469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:46.985587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:46.985994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:46.986646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:46.987261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:46.992334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:47.078656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:47.080902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:47.094303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 943/1891] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:47.152622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5a544-f4cd-4240-b0f0-260a62f5e532 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:47.158217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:47.159112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:47.159404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:47.159687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] PATH_INFO: `/v3/users/ba0fb092810945a589f1d7eee90c2150` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:47.162503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0fb092810945a589f1d7eee90c2150)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:47.164535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:47.533278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0fb092810945a589f1d7eee90c2150'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:47.536851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0fb092810945a589f1d7eee90c2150'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:47.543616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0fb092810945a589f1d7eee90c2150'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:47.564534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0fb092810945a589f1d7eee90c2150'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:47.568491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0fb092810945a589f1d7eee90c2150'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:47.705086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 949/1892] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:46 2022] DELETE /identity/v3/users/ba0fb092810945a589f1d7eee90c2150 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:47.745316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:47.747397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:47.798499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84470-ab10-445f-b80d-014e43e2bce5 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:47.894625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:47.895550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:47.895872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:47.896155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] PATH_INFO: `/v3/projects/ade9aaa145484c269895565c82d09745` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:47.902783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade9aaa145484c269895565c82d09745)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:47.904918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:48.091426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade9aaa145484c269895565c82d09745', 'request_id': 'req-d70786cf-ba72-475c-b82d-7e20ad0af39f'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.102466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade9aaa145484c269895565c82d09745', 'request_id': 'req-d70786cf-ba72-475c-b82d-7e20ad0af39f'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.236264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade9aaa145484c269895565c82d09745', 'request_id': 'req-d70786cf-ba72-475c-b82d-7e20ad0af39f'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.251784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] The token cache is being invalidate because project ade9aaa145484c269895565c82d09745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:48.252106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.252773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.254908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 944/1893] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:47 2022] DELETE /identity/v3/projects/ade9aaa145484c269895565c82d09745 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:48.259349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:48.261001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:48.275941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77e783-fcd3-48d1-856c-64edf1af8d6f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:48.343721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:48.344663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:48.344915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:48.345188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] PATH_INFO: `/v3/users/a9e595462c254db89b286fc4b97d7d77` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:48.346410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e595462c254db89b286fc4b97d7d77)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:48.349035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:48.461138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:48.463171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:48.482457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70786cf-ba72-475c-b82d-7e20ad0af39f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:48.490879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:48.491824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:48.492191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:48.493076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] PATH_INFO: `/v3/projects/0150b1824fd04fb8a82f21f78b12d618` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:48.493891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0150b1824fd04fb8a82f21f78b12d618)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:48.501385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:48.724853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0150b1824fd04fb8a82f21f78b12d618', 'request_id': 'req-1744a639-5a71-4b09-8c58-3fa5debc0b30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.729620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e595462c254db89b286fc4b97d7d77'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.730303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e595462c254db89b286fc4b97d7d77'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.731056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0150b1824fd04fb8a82f21f78b12d618', 'request_id': 'req-1744a639-5a71-4b09-8c58-3fa5debc0b30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.740036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e595462c254db89b286fc4b97d7d77'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.757633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e595462c254db89b286fc4b97d7d77'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.778519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9a6ccce7-e8d6-4504-8b3b-8a9a5e17ade0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e595462c254db89b286fc4b97d7d77'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.888994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0150b1824fd04fb8a82f21f78b12d618', 'request_id': 'req-1744a639-5a71-4b09-8c58-3fa5debc0b30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.924671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] The token cache is being invalidate because project 0150b1824fd04fb8a82f21f78b12d618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:48.925188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.927340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:48.943092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 945/1894] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:48 2022] DELETE /identity/v3/projects/0150b1824fd04fb8a82f21f78b12d618 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:09:48.956189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:48.962699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:49.027618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 950/1895] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:48 2022] DELETE /identity/v3/users/a9e595462c254db89b286fc4b97d7d77 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:49.033151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.036274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.036274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.059404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a639-5a71-4b09-8c58-3fa5debc0b30 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.073504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:49.073504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:49.173705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 951/1896] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:49.174734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:49.182544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:49.193518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.194495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.195133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.195133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] PATH_INFO: `/v3/users/0521aa67995c4fa1affa29c40a801014` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.196345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0521aa67995c4fa1affa29c40a801014)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.198341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:49.277761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ba242-3bf9-4cd6-aedc-60c4f6851a23 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.283102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97ea3942931643a58c5fc0a5fa9fbaf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489fe59c183d448c998a1e20c1fccb72', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.283864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.284151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.284463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.285210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:49.286334 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.288379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e9b56-728c-45ea-8cbf-e69a1a136025 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:49.317442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 952/1897] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:49.324012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.324475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.324895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.346586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:49.348732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:49.362016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 953/1898] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:49.362961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:49.381021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f24eb2-2fb7-4013-89e3-a3860617a03f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.387413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97ea3942931643a58c5fc0a5fa9fbaf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489fe59c183d448c998a1e20c1fccb72', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.388275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.388537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.388828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.389537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.391453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:49.530216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 954/1899] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:49 2022] POST /identity/v3/projects => generated 353 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:49.531564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:49.605045 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd378f-c1d1-473b-8a60-7a8f764b3012 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.610749 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.611491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.611795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.612114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.613030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:49.613185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.615154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:49.627390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 955/1900] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:49.628278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:49.677674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0521aa67995c4fa1affa29c40a801014'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.692832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0521aa67995c4fa1affa29c40a801014'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.702558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6fe0-52fe-4d85-9b99-87aa1d5d9417 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.714392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97ea3942931643a58c5fc0a5fa9fbaf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489fe59c183d448c998a1e20c1fccb72', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.715089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.715393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.716992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.716992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:49.717181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.721311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:49.727707 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0521aa67995c4fa1affa29c40a801014'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.728775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0521aa67995c4fa1affa29c40a801014'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.729249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0521aa67995c4fa1affa29c40a801014'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.731709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 956/1901] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:49.732637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:49.734366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:49.748965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bedc78-1c9b-41d7-ba5f-c1f26d0e1fd6 tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.753659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.755392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.755664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.755986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] PATH_INFO: `/v3/projects/a1fbb340181f424eaa6f81caf5cc7d54` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.757214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fbb340181f424eaa6f81caf5cc7d54)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.759180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:49.842728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 946/1902] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:48 2022] DELETE /identity/v3/users/0521aa67995c4fa1affa29c40a801014 => generated 0 bytes in 899 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:49.844055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:49.845585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:49.860597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fbb340181f424eaa6f81caf5cc7d54', 'request_id': 'req-de5681a5-eb4e-4687-a5ff-fee0b3676163'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.869024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fbb340181f424eaa6f81caf5cc7d54', 'request_id': 'req-de5681a5-eb4e-4687-a5ff-fee0b3676163'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.876326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fbb340181f424eaa6f81caf5cc7d54', 'request_id': 'req-de5681a5-eb4e-4687-a5ff-fee0b3676163'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.921364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ee308-2c7d-455c-ad23-7786d77ecf3b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:49.979800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] The token cache is being invalidate because project a1fbb340181f424eaa6f81caf5cc7d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:49.980135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.981809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-de5681a5-eb4e-4687-a5ff-fee0b3676163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:49.989141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 957/1903] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:49 2022] DELETE /identity/v3/projects/a1fbb340181f424eaa6f81caf5cc7d54 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:49.991370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a18e-babf-4f6a-bb69-ff8ad115a2ac None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.991729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a18e-babf-4f6a-bb69-ff8ad115a2ac None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.992091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a18e-babf-4f6a-bb69-ff8ad115a2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.995900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f5c02-c403-4ddb-85f3-4cd8ec8705ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:49.995900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f5c02-c403-4ddb-85f3-4cd8ec8705ec admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:49.995900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f5c02-c403-4ddb-85f3-4cd8ec8705ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:49.995900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f5c02-c403-4ddb-85f3-4cd8ec8705ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:49.996492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f5c02-c403-4ddb-85f3-4cd8ec8705ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:49.998533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f5c02-c403-4ddb-85f3-4cd8ec8705ec admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.015355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-16a4a18e-babf-4f6a-bb69-ff8ad115a2ac None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:50.016725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-16a4a18e-babf-4f6a-bb69-ff8ad115a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.026918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 958/1904] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:50.028273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.028564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.028851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.049870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:50.051767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.060713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 959/1905] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:50.065331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.065331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.127082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4853-49f9-4dc2-ad9b-2d1aec03e71d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.130999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.132611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.132908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.133181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.147674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.147674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.158337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 947/1906] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:49 2022] POST /identity/v3/projects => generated 407 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:50.158337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.158337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.158337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.167122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 960/1907] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:50.168050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.171530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.181706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:50.187036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.258358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 948/1908] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:50.258358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.258358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.272595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8c19-4a1e-4cb1-bb88-4b2c44ae6355 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.279275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.280075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.280755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.281038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.281753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.283742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.309118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88200ca4-6ce9-4adc-8cd0-2203baddcddd service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.380014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 949/1909] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:50 2022] POST /identity/v3/users => generated 304 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:50.380964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.386625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97ea3942931643a58c5fc0a5fa9fbaf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489fe59c183d448c998a1e20c1fccb72', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.387934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.389141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.390566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] PATH_INFO: `/v3/projects/7134c1af3d354838853916b838382d86` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.392746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7134c1af3d354838853916b838382d86)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.394463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1e53a-b070-4b1b-a10d-7a9f79fd2893 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.396270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.401632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.402492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.402782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.403061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.404039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:50.404351 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.406816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.421365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 950/1910] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:50.422168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.439848 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c6b6f-65a6-4743-8202-db9185294dec admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.449290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.449971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.450252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.450528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.451276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.453045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.472483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 951/1911] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:50.473906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.492038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac18d-6d63-4490-b00d-54219efdb3a3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.492971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.493641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.493924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.494199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.494973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.502168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.571250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7134c1af3d354838853916b838382d86', 'request_id': 'req-d7883775-e794-4b28-afc4-3495904b14ee'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:50.578331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7134c1af3d354838853916b838382d86', 'request_id': 'req-d7883775-e794-4b28-afc4-3495904b14ee'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:50.584520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7134c1af3d354838853916b838382d86', 'request_id': 'req-d7883775-e794-4b28-afc4-3495904b14ee'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:50.626687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 952/1912] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:50 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:50.627736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.663370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] The token cache is being invalidate because project 7134c1af3d354838853916b838382d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:50.664019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:50.664976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:50.667533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 961/1913] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:50 2022] DELETE /identity/v3/projects/7134c1af3d354838853916b838382d86 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:50.668726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.671814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.742401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7443ef-d1d7-4cf5-ba5a-a0b9a0a58efe admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.750019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.750930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.751326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.751736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.752623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.754832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.761994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7883775-e794-4b28-afc4-3495904b14ee tempest-VolumeQuotaClassesTest-931864820 tempest-VolumeQuotaClassesTest-931864820-project-admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.769980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 953/1914] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:50.770180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.770289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.771529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.771529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.771529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.771529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.771916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.772031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.796091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22cf6e-2d93-4094-890b-3f3b3d64e778 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.805368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.806894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.807424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.807981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] PATH_INFO: `/v3/projects/01d0162993834be088e2565cf466f9e5` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.810071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d0162993834be088e2565cf466f9e5)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.814010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.872580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 962/1915] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:50 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:50.873402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:50.875193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:50.887565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7820336-01e7-456b-a54a-5f4439b4282f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:50.893458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:50.894352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:50.894671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:50.894978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] PATH_INFO: `/v3/projects/b20bd0883bfe4d5b87e921f2277d25a7/users/38d1261b735140149620bb5389d9f8c4/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:50.911807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20bd0883bfe4d5b87e921f2277d25a7, user_id=38d1261b735140149620bb5389d9f8c4, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:50.914588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:50.992945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 963/1916] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:50 2022] PUT /identity/v3/projects/b20bd0883bfe4d5b87e921f2277d25a7/users/38d1261b735140149620bb5389d9f8c4/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:50.994399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.000961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d0162993834be088e2565cf466f9e5', 'request_id': 'req-e836faa5-129a-4de5-8301-8c047bf6fae0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.010780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d0162993834be088e2565cf466f9e5', 'request_id': 'req-e836faa5-129a-4de5-8301-8c047bf6fae0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.070417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52432bf8-8b23-4cab-9353-81715de9902b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.087363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d0162993834be088e2565cf466f9e5', 'request_id': 'req-e836faa5-129a-4de5-8301-8c047bf6fae0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.101983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] The token cache is being invalidate because project 01d0162993834be088e2565cf466f9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:51.102308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.104009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-e836faa5-129a-4de5-8301-8c047bf6fae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.105355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 954/1917] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:50 2022] DELETE /identity/v3/projects/01d0162993834be088e2565cf466f9e5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:51.106651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.107635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.107635 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.143031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.143647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] MFA Rules not processed for user `38d1261b735140149620bb5389d9f8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:51.143821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.144017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.144278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.145665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.145877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.148005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:51.167306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 964/1918] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:51.168476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.171035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.190873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec58a8-9192-4419-871f-778832e47c4c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.199584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.200787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.201458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.201744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] PATH_INFO: `/v3/users/7f0ad3af97dc4f40a3ad5a44934ae019` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.203134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0ad3af97dc4f40a3ad5a44934ae019)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.205647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:51.270084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 955/1919] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:51.272038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.273793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.297102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4154-6633-4ca0-b58f-0414e0526466 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.305485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.308511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.308511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.308511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.309062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.312080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:51.331088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 956/1920] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:51.333417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.336942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.372443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521addac-8c23-401d-ba86-57932ac38bda admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.373678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.374669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.374976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.375264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.376486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.379654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:51.538257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0ad3af97dc4f40a3ad5a44934ae019'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.539500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0ad3af97dc4f40a3ad5a44934ae019'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.546940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0ad3af97dc4f40a3ad5a44934ae019'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.559598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0ad3af97dc4f40a3ad5a44934ae019'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.560465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0ad3af97dc4f40a3ad5a44934ae019'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:51.577413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 957/1921] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:51 2022] POST /identity/v3/projects => generated 409 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:51.577413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.577413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.670004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae2e16-19f3-45e8-8f2c-61b7ee66699b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.676781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.678036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.678327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.678611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] PATH_INFO: `/v3/projects/f164bb60ee634115a9f2f5a2ee30bd7f/users/d8338f43de8f457db0b9b7ca42dea369/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.687283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 965/1922] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:51 2022] DELETE /identity/v3/users/7f0ad3af97dc4f40a3ad5a44934ae019 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:51.688233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.689680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.698164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f164bb60ee634115a9f2f5a2ee30bd7f, user_id=d8338f43de8f457db0b9b7ca42dea369, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.701024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:51.775821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 958/1923] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:51 2022] PUT /identity/v3/projects/f164bb60ee634115a9f2f5a2ee30bd7f/users/d8338f43de8f457db0b9b7ca42dea369/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:51.776713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:51.783155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:51.787403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81b73-3096-4360-94d5-fd62ff18a797 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.866812 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.868367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.868727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.869241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] PATH_INFO: `/v3/users/24ddca6ff59742f991cec1707645ed29` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.871211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ddca6ff59742f991cec1707645ed29)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.873464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:51.887129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b37a46-b273-45c9-99bd-50dbaee01506 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:51.895811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d8e19-4a38-4e60-872e-95741d5f96d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:51.896791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8e19-4a38-4e60-872e-95741d5f96d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:51.897140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8e19-4a38-4e60-872e-95741d5f96d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:51.900798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d8e19-4a38-4e60-872e-95741d5f96d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:51.900798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d8e19-4a38-4e60-872e-95741d5f96d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:51.902518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d8e19-4a38-4e60-872e-95741d5f96d1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:52.076620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 959/1924] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:51 2022] POST /identity/v3/users => generated 311 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:52.078871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.079349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.079788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.104658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ddca6ff59742f991cec1707645ed29'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.105347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ddca6ff59742f991cec1707645ed29'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.110723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] MFA Rules not processed for user `d8338f43de8f457db0b9b7ca42dea369`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:52.112029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.113323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ddca6ff59742f991cec1707645ed29'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.128471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ddca6ff59742f991cec1707645ed29'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.129759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ddca6ff59742f991cec1707645ed29'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.203465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 966/1925] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:51 2022] DELETE /identity/v3/users/24ddca6ff59742f991cec1707645ed29 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:52.205333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:52.210393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.241912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 960/1926] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:52.243103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:52.244900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.263428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf57e4-12d3-49c7-80d9-da81ee72a609 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:52.359207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9229a-e6e1-4390-8fb6-ca2320954a76 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:52.365395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb2548-c806-4a91-a606-84ff6ee913cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:52.366092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb2548-c806-4a91-a606-84ff6ee913cc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.366409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb2548-c806-4a91-a606-84ff6ee913cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.366688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb2548-c806-4a91-a606-84ff6ee913cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.367443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb2548-c806-4a91-a606-84ff6ee913cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:52.369277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb2548-c806-4a91-a606-84ff6ee913cc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:52.378761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:52.379674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.380008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.380282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] PATH_INFO: `/v3/projects/d2a9df64d9204060982ab4973fc96c75` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.381572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a9df64d9204060982ab4973fc96c75)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:52.384355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:52.385345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 967/1927] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:52.386876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.387384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.387869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.411287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:52.412727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.423347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 968/1928] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:52.424491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:52.426842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.449895 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89dadc-a1ea-4944-b484-40eb036d2261 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:52.458076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:52.459398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.459892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.460342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.461532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:52.465113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:52.506291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a9df64d9204060982ab4973fc96c75', 'request_id': 'req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.514804 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a9df64d9204060982ab4973fc96c75', 'request_id': 'req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.585727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 969/1929] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:52 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:52.585727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:52.624691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a9df64d9204060982ab4973fc96c75', 'request_id': 'req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.647927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] The token cache is being invalidate because project d2a9df64d9204060982ab4973fc96c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:52.647927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.649023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:52.657309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 961/1930] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:52 2022] DELETE /identity/v3/projects/d2a9df64d9204060982ab4973fc96c75 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:52.657309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:52.657783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.716127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262848d4-ec18-4e71-97b1-83b713f05dec admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:52.727274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33b3cc-d218-4253-a9f5-149bd0812dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:52.728887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33b3cc-d218-4253-a9f5-149bd0812dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.729402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33b3cc-d218-4253-a9f5-149bd0812dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.730099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33b3cc-d218-4253-a9f5-149bd0812dc3 admin admin] PATH_INFO: `/v3/projects/4bab49c4c5844982948614f72e10f3e7/users/27267d09386b46ec8c6110dcc7edadf7/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.738992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da6a5f-e60a-409c-aad6-ab9dba5e7bbb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:52.764718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33b3cc-d218-4253-a9f5-149bd0812dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bab49c4c5844982948614f72e10f3e7, user_id=27267d09386b46ec8c6110dcc7edadf7, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:52.769669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33b3cc-d218-4253-a9f5-149bd0812dc3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:52.809548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:52.810208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.810496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.810774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.812704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.827087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:52.828724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:52.840121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 962/1931] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:52.841065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:52.842561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.860509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b4ae-0175-47e5-bcc4-2a2fac68d030 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:52.861829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 970/1932] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:52 2022] PUT /identity/v3/projects/4bab49c4c5844982948614f72e10f3e7/users/27267d09386b46ec8c6110dcc7edadf7/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:52.863574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.863978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.864311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.886759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:52.888341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:52.954036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1fd3c-0d94-4737-9918-1dd91648f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:52.954615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fd3c-0d94-4737-9918-1dd91648f2ba admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:52.954947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fd3c-0d94-4737-9918-1dd91648f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:52.955233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1fd3c-0d94-4737-9918-1dd91648f2ba admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:52.955991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1fd3c-0d94-4737-9918-1dd91648f2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:52.958861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1fd3c-0d94-4737-9918-1dd91648f2ba admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.024203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 971/1933] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:53.024203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.024203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:53.033101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80ca66-9d0a-45ec-9891-788c7d241ba0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.042051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.043230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.043729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.044283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.045897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.049200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.063521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 963/1934] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:52 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:53.065885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.072052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 972/1935] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:53.072453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.073198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.074106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.099194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:53.102010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f1bfa-a461-49f7-93bb-1ee67b2dc4ba admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.102870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:53.108167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.108994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.109401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.114227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.115160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.117090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.125004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 964/1936] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:53.126857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.134708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 973/1937] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:53.135701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.148767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c766c-d29e-493d-87ef-5b70fadd27d1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.151211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f882a9-c764-4661-9d8c-a136dc8a93e1 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.156251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.156949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.157266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.157997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.159071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:53.159456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.161418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.163282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.163764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.164292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] PATH_INFO: `/v3/projects/4bab49c4c5844982948614f72e10f3e7/users/27267d09386b46ec8c6110dcc7edadf7/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.164428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.167991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bab49c4c5844982948614f72e10f3e7, user_id=27267d09386b46ec8c6110dcc7edadf7, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.174187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.182008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 974/1938] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:53.185825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.198776 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf17615-0c51-4012-a624-ea0705a0e394 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.214305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 965/1939] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:53 2022] PUT /identity/v3/projects/4bab49c4c5844982948614f72e10f3e7/users/27267d09386b46ec8c6110dcc7edadf7/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:53.214305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.293326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.294450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.294759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.295022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] PATH_INFO: `/v3/projects/4abb6edae5dc44c4b4d34d06dd73b7ea/users/549eb8181053445d9ec82a9d5072da46/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.325681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abb6edae5dc44c4b4d34d06dd73b7ea, user_id=549eb8181053445d9ec82a9d5072da46, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.328305 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433b84-98e8-4394-ba1c-1d6aac50022a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.329763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.336796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79571452-93fc-464c-9b59-113bde0e4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.338505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571452-93fc-464c-9b59-113bde0e4359 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.339108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571452-93fc-464c-9b59-113bde0e4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.339691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79571452-93fc-464c-9b59-113bde0e4359 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.341162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79571452-93fc-464c-9b59-113bde0e4359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.345303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79571452-93fc-464c-9b59-113bde0e4359 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.484854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 966/1940] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:53 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:53.486941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.487349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.487874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.496477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 975/1941] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:53 2022] PUT /identity/v3/projects/4abb6edae5dc44c4b4d34d06dd73b7ea/users/549eb8181053445d9ec82a9d5072da46/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:53.499077 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.502662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:53.520395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] MFA Rules not processed for user `27267d09386b46ec8c6110dcc7edadf7`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:53.521802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:53.589435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bea20a-8ccb-4b80-b256-9275d5aaca70 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.604398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 967/1942] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:53.605242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.653921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.654916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.655282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.655642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] PATH_INFO: `/v3/users/083fd7acaf534eaa8c336850f22cc06c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.657043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083fd7acaf534eaa8c336850f22cc06c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.659690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.698092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38a623-487c-49ec-b49a-7b8cf20a85f0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.702703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.703373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.703652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.703964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.704653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.706547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.790902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 968/1943] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:53 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:53.792159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.793899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:53.806482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535761f-5930-4613-8e43-dc72919b26fc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:53.811741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:53.813021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:53.813458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:53.813905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] PATH_INFO: `/v3/projects/0f9782f3ede64b229c3a953c0c4b4d99` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:53.815103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9782f3ede64b229c3a953c0c4b4d99)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:53.818016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:53.844685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083fd7acaf534eaa8c336850f22cc06c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.845496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083fd7acaf534eaa8c336850f22cc06c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.853399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083fd7acaf534eaa8c336850f22cc06c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.872997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083fd7acaf534eaa8c336850f22cc06c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.873714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083fd7acaf534eaa8c336850f22cc06c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.928819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9782f3ede64b229c3a953c0c4b4d99', 'request_id': 'req-11b753ac-eedf-4b86-9aea-705e63716c2d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.934181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9782f3ede64b229c3a953c0c4b4d99', 'request_id': 'req-11b753ac-eedf-4b86-9aea-705e63716c2d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:53.944689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 976/1944] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:53 2022] DELETE /identity/v3/users/083fd7acaf534eaa8c336850f22cc06c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:53.945567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:53.946920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.012726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9782f3ede64b229c3a953c0c4b4d99', 'request_id': 'req-11b753ac-eedf-4b86-9aea-705e63716c2d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.027643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] The token cache is being invalidate because project 0f9782f3ede64b229c3a953c0c4b4d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:54.028217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.028927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.031030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 969/1945] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:53 2022] DELETE /identity/v3/projects/0f9782f3ede64b229c3a953c0c4b4d99 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:54.031696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.033184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.040781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e010936-d39f-4849-a401-34daf2e92886 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.049353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.050580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.051593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.052112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.053674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.056897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.084157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 977/1946] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:54.085491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.087529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.100669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b753ac-eedf-4b86-9aea-705e63716c2d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.102296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8f7d3-04a2-4696-818a-820bf48aa2fa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.107549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.108442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.108731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.109009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.109763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.111403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.131145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 978/1947] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:54.133135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.136343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.150884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99973f5-500f-4e5e-aace-d939a8e10985 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.156227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.157124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.157432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.157695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] PATH_INFO: `/v3/users/97ea3942931643a58c5fc0a5fa9fbaf7` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.159047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] RBAC: Authorizing `identity:delete_user(user_id=97ea3942931643a58c5fc0a5fa9fbaf7)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.161998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.172085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.172756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.173040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.173329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.175196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.256426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.257899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.269978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 970/1948] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:54 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:54.270610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.272053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.286556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657b85d-7e56-4340-80f9-929911d6531f service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.291772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.292714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.293004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.293280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] PATH_INFO: `/v3/projects/4abb6edae5dc44c4b4d34d06dd73b7ea/users/549eb8181053445d9ec82a9d5072da46/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.295348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abb6edae5dc44c4b4d34d06dd73b7ea, user_id=549eb8181053445d9ec82a9d5072da46, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.298034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.309226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 971/1949] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:54 2022] PUT /identity/v3/projects/4abb6edae5dc44c4b4d34d06dd73b7ea/users/549eb8181053445d9ec82a9d5072da46/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:54.310108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.348244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97ea3942931643a58c5fc0a5fa9fbaf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.349139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97ea3942931643a58c5fc0a5fa9fbaf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.366535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97ea3942931643a58c5fc0a5fa9fbaf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.386274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97ea3942931643a58c5fc0a5fa9fbaf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.387034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f4545c9d-fbec-49c4-ab0d-4571874315be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97ea3942931643a58c5fc0a5fa9fbaf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.406504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d2b63-d4ab-44f2-ad57-6e5b0ab07f77 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.413013 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.413784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.414167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.414531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.415341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.417096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.430841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 972/1950] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:54.431869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.434289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.451484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69985318-c21e-4979-a6df-fd14c9267c4b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.458184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.459119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.463703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.463703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] PATH_INFO: `/v3/projects/9435a9d7a20b4e4fb7768495d4d0e229` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.463703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9435a9d7a20b4e4fb7768495d4d0e229)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.463703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:54.481455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 979/1951] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:54 2022] DELETE /identity/v3/users/97ea3942931643a58c5fc0a5fa9fbaf7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:54.484521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.485046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.485658 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.530741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] MFA Rules not processed for user `549eb8181053445d9ec82a9d5072da46`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:54.532152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.653189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 980/1952] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:54.657169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:54.662449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:54.697398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9435a9d7a20b4e4fb7768495d4d0e229', 'request_id': 'req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.710034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9435a9d7a20b4e4fb7768495d4d0e229', 'request_id': 'req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:54.820428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e08d51-1ed0-4d59-8faf-963fe84fbd70 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:54.920751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:54.921898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:54.922331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:54.922869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] PATH_INFO: `/v3/projects/353968dbddac4fc6828ffc518e5d6ab4/users/7cfa23b7d5604135821c391a849c7eaf/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:54.943954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353968dbddac4fc6828ffc518e5d6ab4, user_id=7cfa23b7d5604135821c391a849c7eaf, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:54.947145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:55.036769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9435a9d7a20b4e4fb7768495d4d0e229', 'request_id': 'req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.052819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] The token cache is being invalidate because project 9435a9d7a20b4e4fb7768495d4d0e229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:55.053109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.053781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.055384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 973/1953] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:54 2022] DELETE /identity/v3/projects/9435a9d7a20b4e4fb7768495d4d0e229 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:55.056206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:55.057514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.076183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 981/1954] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:54 2022] PUT /identity/v3/projects/353968dbddac4fc6828ffc518e5d6ab4/users/7cfa23b7d5604135821c391a849c7eaf/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:55.126399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:55.126399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.155204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc15cc-feea-44c0-b3f1-1a3a7a085e10 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:55.184195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f2915-2da7-4616-8f63-e9f21c3d51f5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:55.189442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:55.190403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:55.190737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:55.190973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:55.194173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.228971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:55.230146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:55.230889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:55.230889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:55.233145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.296993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:55.298532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:55.309574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 982/1955] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:55.310344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:55.311744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.343720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:55.346447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77143b9c-ce43-4341-8a4d-fee7decc6840 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:55.384221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 974/1956] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:55.386948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:55.388191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:55.388973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:55.403372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc000b-88a6-4af3-918c-38422313c821 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:55.419739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:55.420932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:55.421382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:55.422006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] PATH_INFO: `/v3/users/86206d7462644827a713e04a8a60c28b` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:55.424957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86206d7462644827a713e04a8a60c28b)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:55.429013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:55.430464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] MFA Rules not processed for user `7cfa23b7d5604135821c391a849c7eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:55.432059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.517307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 975/1957] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:55.518057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:55.520547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.534737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9474-57a1-4829-9534-f16644935c6b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:55.541114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:55.542009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:55.542314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:55.542593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] PATH_INFO: `/v3/projects/489fe59c183d448c998a1e20c1fccb72` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:55.543802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=489fe59c183d448c998a1e20c1fccb72)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:55.545810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:55.641684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86206d7462644827a713e04a8a60c28b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.642377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86206d7462644827a713e04a8a60c28b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.649823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86206d7462644827a713e04a8a60c28b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.663327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86206d7462644827a713e04a8a60c28b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.664487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86206d7462644827a713e04a8a60c28b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.706699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489fe59c183d448c998a1e20c1fccb72', 'request_id': 'req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.714157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489fe59c183d448c998a1e20c1fccb72', 'request_id': 'req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.802423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 983/1958] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:55 2022] DELETE /identity/v3/users/86206d7462644827a713e04a8a60c28b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:55.803545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:55.805145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.854979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489fe59c183d448c998a1e20c1fccb72', 'request_id': 'req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.890166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] The token cache is being invalidate because project 489fe59c183d448c998a1e20c1fccb72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:55.890809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.892212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:55.895108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 976/1959] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:55 2022] DELETE /identity/v3/projects/489fe59c183d448c998a1e20c1fccb72 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:55.897010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:55.899131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:55.925425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9207d3-8dca-4b66-908c-3250935da908 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:55.934106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0d4e8-0dff-4774-a47d-6bedfc66324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:55.935320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d4e8-0dff-4774-a47d-6bedfc66324c admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:55.935800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d4e8-0dff-4774-a47d-6bedfc66324c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:55.936292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0d4e8-0dff-4774-a47d-6bedfc66324c admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:55.937459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d4e8-0dff-4774-a47d-6bedfc66324c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:55.942054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0d4e8-0dff-4774-a47d-6bedfc66324c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.002596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b741fd2-69d2-4683-bc1e-af6f76a60b5b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.048358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 984/1960] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:55 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:56.048358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.048358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.048358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.080738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.081421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.081867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.082607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.085074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.098584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:56.102206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.164709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.166375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.179313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 977/1961] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:56.180185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.182053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.198146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011afdee-b220-431b-8447-dab4c3851c32 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.316722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8562-e2b9-4fbf-a8fa-d747d22b5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.317837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8562-e2b9-4fbf-a8fa-d747d22b5ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.318278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8562-e2b9-4fbf-a8fa-d747d22b5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.318725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8562-e2b9-4fbf-a8fa-d747d22b5ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.320134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8562-e2b9-4fbf-a8fa-d747d22b5ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.324138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8562-e2b9-4fbf-a8fa-d747d22b5ee4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.335824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 985/1962] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:56.337533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.339820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.371429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5726f29-2332-41a8-b99c-870b926df53e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.378815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.379813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.380150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.380426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] PATH_INFO: `/v3/projects/e23f1cbf89244625a52a1cc4fd053069` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.381753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23f1cbf89244625a52a1cc4fd053069)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.383861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.474697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 978/1963] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/users => generated 296 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:56.476058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.476355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.476831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.499982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:56.501546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.516083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23f1cbf89244625a52a1cc4fd053069', 'request_id': 'req-9807ff79-a95c-4833-92e7-41e5a9120ca7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:56.525799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23f1cbf89244625a52a1cc4fd053069', 'request_id': 'req-9807ff79-a95c-4833-92e7-41e5a9120ca7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:56.533969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23f1cbf89244625a52a1cc4fd053069', 'request_id': 'req-9807ff79-a95c-4833-92e7-41e5a9120ca7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:56.578263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 979/1964] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:56.579410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.590283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbac0c1-1452-4f61-9f53-eb40f673dd5e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.595071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.595764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.596077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.596357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.597100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.599571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.610782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 980/1965] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:56.611682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.614959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] The token cache is being invalidate because project e23f1cbf89244625a52a1cc4fd053069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:56.615509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:56.616571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:56.619293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 986/1966] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:56 2022] DELETE /identity/v3/projects/e23f1cbf89244625a52a1cc4fd053069 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:56.620347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.622272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.627221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f64c9-3e5e-4739-ae07-401473af4674 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.641148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.641881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.642163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.642464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.643202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:56.643494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.643866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807ff79-a95c-4833-92e7-41e5a9120ca7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.646448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e5621-7627-464d-af87-76fda1978be4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.651638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a89cb-b577-42a5-aba6-cda6d71f9b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.652869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a89cb-b577-42a5-aba6-cda6d71f9b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.653322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a89cb-b577-42a5-aba6-cda6d71f9b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.653739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a89cb-b577-42a5-aba6-cda6d71f9b67 admin admin] PATH_INFO: `/v3/projects/8dc9ad0f8072446cbba377f5593f1356/users/6690d98bdf254dc699d5433954872126/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.673461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 981/1967] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:56.673461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.673461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.673461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.681983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a89cb-b577-42a5-aba6-cda6d71f9b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc9ad0f8072446cbba377f5593f1356, user_id=6690d98bdf254dc699d5433954872126, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.688834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a89cb-b577-42a5-aba6-cda6d71f9b67 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.702889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:56.705011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.729251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 982/1968] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:56.729251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.729251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.746706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba3b6c-c6a7-40ed-bb02-b48a3a1af4f1 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.751691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.752457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.752751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.753036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.754382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.757214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.776238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 987/1969] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:56 2022] PUT /identity/v3/projects/8dc9ad0f8072446cbba377f5593f1356/users/6690d98bdf254dc699d5433954872126/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:56.778779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.779293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.779779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.800727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:56.802320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.849092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 983/1970] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:56.849092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.875061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 988/1971] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:56.876549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.881006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:56.899050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c48a79-69c7-470c-856a-b38faa2ffcad None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.944142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3676f-0349-4fe0-b309-d472e8e238a3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.949181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.949867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.950153 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.950435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.951317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.953224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.965074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 984/1972] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:56.971453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:56.982039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.983060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.983354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.983635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] PATH_INFO: `/v3/users/d8338f43de8f457db0b9b7ca42dea369` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:56.985063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8338f43de8f457db0b9b7ca42dea369)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:56.987049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:56.988908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe9bfa-a64d-46c0-a0f3-3b1dfcf8b893 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:56.997262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:56.998396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:56.998894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:56.999855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.000801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.005241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.118501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 985/1973] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:56 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:57.119443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.131335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cc2dd-46f7-4112-b999-5810080fcf89 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.137219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.137910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.138233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.138511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.139238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:09:57.139548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.141241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.156844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 986/1974] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:09:57.157666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.170778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4e078-35e5-4f80-8698-86dcc5f6e635 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.176608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.177575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.177856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.178137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] PATH_INFO: `/v3/projects/8dc9ad0f8072446cbba377f5593f1356/users/6690d98bdf254dc699d5433954872126/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.180337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc9ad0f8072446cbba377f5593f1356, user_id=6690d98bdf254dc699d5433954872126, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.183164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.196435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 987/1975] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:57 2022] PUT /identity/v3/projects/8dc9ad0f8072446cbba377f5593f1356/users/6690d98bdf254dc699d5433954872126/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:57.196688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.222047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8338f43de8f457db0b9b7ca42dea369'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:57.224102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8338f43de8f457db0b9b7ca42dea369'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:57.236001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8338f43de8f457db0b9b7ca42dea369'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:57.252957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8338f43de8f457db0b9b7ca42dea369'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:57.254260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-726ead08-8ac1-458e-b10c-0a8088cb2bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8338f43de8f457db0b9b7ca42dea369'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:57.295607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c718a04-df7b-4015-b730-c77f27b69f5b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.300872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.301568 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.301905 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.302124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.302862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.304563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.316274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 988/1976] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:57.317203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.319027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:57.334419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a2d48-71eb-4a44-b9ae-54292621ceab admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.339458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.340817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.341315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.341871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.343217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.347006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.364851 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 989/1977] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:56 2022] DELETE /identity/v3/users/d8338f43de8f457db0b9b7ca42dea369 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:57.367898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215fba3-4c21-4bf6-8c90-642e73165511 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.368247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215fba3-4c21-4bf6-8c90-642e73165511 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.372558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215fba3-4c21-4bf6-8c90-642e73165511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.410729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d215fba3-4c21-4bf6-8c90-642e73165511 None None] MFA Rules not processed for user `6690d98bdf254dc699d5433954872126`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:57.413825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d215fba3-4c21-4bf6-8c90-642e73165511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:57.461793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 989/1978] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:57.463289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.465341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:57.543524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 990/1979] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:57.544978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.545271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.545550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.557533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a2137-7e33-4c82-9122-3ff293173b92 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.569135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.570279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.571018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.571685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.573112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.576166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.578943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:57.580294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:57.590094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 991/1980] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:57.590940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.598947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 990/1981] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:57.600649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.604448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:57.611365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fae3ca-892f-4dce-9082-cbcf233ec258 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.619120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.620081 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.620372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.620663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.621384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.623533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.682080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178afc-e70c-4f5e-8666-57a28afa12ad admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.686161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.686823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.687111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.687403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.735876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 992/1982] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:57 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:57.735876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.748083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3e4cb-d42c-42ae-b7d4-7f143cc202e8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.754488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a7342-a181-49dd-bd08-182aa5cc4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.756030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a7342-a181-49dd-bd08-182aa5cc4dd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.756321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a7342-a181-49dd-bd08-182aa5cc4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.756599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a7342-a181-49dd-bd08-182aa5cc4dd2 admin admin] PATH_INFO: `/v3/projects/bfaef58af71e460ca9ec6cd1be58ae58/users/b677563dc83b40c692811c298ae1f1c6/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.761039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.762573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.775280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 991/1983] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:57.775474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a7342-a181-49dd-bd08-182aa5cc4dd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfaef58af71e460ca9ec6cd1be58ae58, user_id=b677563dc83b40c692811c298ae1f1c6, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.776123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.777625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:57.778562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a7342-a181-49dd-bd08-182aa5cc4dd2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.850159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843c39d-9fd8-4fe4-a39d-f435d4f11646 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.854226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:57.854894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.855170 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.855448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.866862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:57.869072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:57.880579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 992/1984] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:57.881380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:57.911670 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 993/1985] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:57 2022] PUT /identity/v3/projects/bfaef58af71e460ca9ec6cd1be58ae58/users/b677563dc83b40c692811c298ae1f1c6/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:57.915063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331afee-2ff5-4738-b6d0-c60cc6da80cf service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:57.918722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:57.920162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:57.920826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:57.986612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] MFA Rules not processed for user `b677563dc83b40c692811c298ae1f1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:57.993318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:58.109265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.110192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.110549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.110894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.111824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.114027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.125173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 993/1986] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:58.130378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.142269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b16b-1ee9-4013-9320-dd24ec5eeceb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.149147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.149954 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.150335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.150737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.151576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.153963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.166662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 994/1987] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:09:58.171435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.178459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 994/1988] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:58.180254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.183598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1524b91-5f1e-4b60-a94c-bf8d6218c87c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.188916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401430c8-1c31-4326-9020-ec66f758a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.190540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401430c8-1c31-4326-9020-ec66f758a1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.190911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401430c8-1c31-4326-9020-ec66f758a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.191888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401430c8-1c31-4326-9020-ec66f758a1e7 admin admin] PATH_INFO: `/v3/projects/39d607e124af4032839d8dee89c47a15/users/96611673c58a46eeac9056c58ee1d98b/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.198624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a0cc-b0a6-4576-ac98-3d5c87a23011 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.209030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.209933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.210224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.210502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.211035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401430c8-1c31-4326-9020-ec66f758a1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d607e124af4032839d8dee89c47a15, user_id=96611673c58a46eeac9056c58ee1d98b, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.211215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.213386 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.214320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401430c8-1c31-4326-9020-ec66f758a1e7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.320266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 995/1989] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:58 2022] PUT /identity/v3/projects/39d607e124af4032839d8dee89c47a15/users/96611673c58a46eeac9056c58ee1d98b/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:58.333145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.333944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.334559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.362030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 995/1990] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:58 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:09:58.366335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.430976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] MFA Rules not processed for user `96611673c58a46eeac9056c58ee1d98b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:58.434212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:58.485217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077682b-01b4-47c8-a579-8045dd5ad91e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.498195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.498881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.499167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.499446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.500197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.502294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.540063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 996/1991] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:09:58.555247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.556747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:58.642772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ebd9e-8ee6-4eaa-9db6-d7f40b4a1e2a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.652750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.659363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.659363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.659363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.659747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 996/1992] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:09:58 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:09:58.659747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.659747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:58.671949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f3bae-4f12-444e-a420-484164188818 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.678650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.679082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.685984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.686083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.686083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.686083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] PATH_INFO: `/v3/projects/f164bb60ee634115a9f2f5a2ee30bd7f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.686083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f164bb60ee634115a9f2f5a2ee30bd7f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.688832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.691144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 997/1993] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:09:58.693110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.708077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083cfb01-8e1f-4f4b-a675-1dd7af88d5c0 service glance] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.722621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.722621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.722621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.722621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.723458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.723458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.736209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 998/1994] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:58.738347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:58.743943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:58.759992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0038b-e2bf-4b01-93a2-d586e576a4ed admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:58.766572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:58.768368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:58.768737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:58.769024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] PATH_INFO: `/v3/users/7cfa23b7d5604135821c391a849c7eaf` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:58.770522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfa23b7d5604135821c391a849c7eaf)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:58.773580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:58.871621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f164bb60ee634115a9f2f5a2ee30bd7f', 'request_id': 'req-168f01df-1e18-4457-94ea-69dc784d425d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.880896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f164bb60ee634115a9f2f5a2ee30bd7f', 'request_id': 'req-168f01df-1e18-4457-94ea-69dc784d425d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.896300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f164bb60ee634115a9f2f5a2ee30bd7f', 'request_id': 'req-168f01df-1e18-4457-94ea-69dc784d425d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.973286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfa23b7d5604135821c391a849c7eaf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.982928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfa23b7d5604135821c391a849c7eaf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.995482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] The token cache is being invalidate because project f164bb60ee634115a9f2f5a2ee30bd7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:09:58.998047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.998047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:58.998612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 997/1995] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:09:58 2022] DELETE /identity/v3/projects/f164bb60ee634115a9f2f5a2ee30bd7f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:58.999525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:59.004418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.005072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfa23b7d5604135821c391a849c7eaf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.006248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfa23b7d5604135821c391a849c7eaf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.007277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfa23b7d5604135821c391a849c7eaf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.081407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f01df-1e18-4457-94ea-69dc784d425d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:59.088410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e23e-3558-4ac9-9730-eb3cd0459fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:59.089628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e23e-3558-4ac9-9730-eb3cd0459fcc admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.089628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e23e-3558-4ac9-9730-eb3cd0459fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.090320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e23e-3558-4ac9-9730-eb3cd0459fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.090645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e23e-3558-4ac9-9730-eb3cd0459fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:59.092385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e23e-3558-4ac9-9730-eb3cd0459fcc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:59.092743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 999/1996] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:58 2022] DELETE /identity/v3/users/7cfa23b7d5604135821c391a849c7eaf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:59.094151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:59.096379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.106303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 998/1997] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:09:59.107853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.108149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.108428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.127518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:59.129611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.189205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec773e-49b9-48ee-92c6-b4dfc88fb780 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:59.195378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:59.196445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.196725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.197005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] PATH_INFO: `/v3/users/549eb8181053445d9ec82a9d5072da46` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.198340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549eb8181053445d9ec82a9d5072da46)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:59.200476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:59.211946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 999/1998] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:59.212770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:59.214605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.237592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e294-96e7-47be-81ac-a5a6882ddcd9 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:59.243694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:59.244655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.244938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.245245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] PATH_INFO: `/v3/projects/07b6ae38729e4269b8fa38249361682f/users/d22f2c43f3524c879c7f55b44ebf1f92/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.262272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b6ae38729e4269b8fa38249361682f, user_id=d22f2c43f3524c879c7f55b44ebf1f92, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:59.265242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:59.409337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1000/1999] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:09:59 2022] PUT /identity/v3/projects/07b6ae38729e4269b8fa38249361682f/users/d22f2c43f3524c879c7f55b44ebf1f92/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:59.415073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:59.416876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.447011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549eb8181053445d9ec82a9d5072da46'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.454730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549eb8181053445d9ec82a9d5072da46'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.469140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549eb8181053445d9ec82a9d5072da46'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.473540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549eb8181053445d9ec82a9d5072da46'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.473540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-72af6369-6ae9-4d3c-be65-dd45a0941ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549eb8181053445d9ec82a9d5072da46'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:09:59.480184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b1762-cb46-4628-a04e-5467aca0f606 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:59.483973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:59.484625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.484982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.485263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.487131 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.552630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:59.554654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:09:59.566913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1000/2000] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:09:59 2022] DELETE /identity/v3/users/549eb8181053445d9ec82a9d5072da46 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:09:59.569190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.570472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1001/2001] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:09:59.578053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.578525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.610146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] MFA Rules not processed for user `d22f2c43f3524c879c7f55b44ebf1f92`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:09:59.611453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.715620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1001/2002] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:09:59.720442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:09:59.721970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:09:59.736816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c51c-ffdc-47b5-bce9-4a118813e865 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:09:59.828055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:09:59.829197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:09:59.829635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:09:59.830015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:09:59.831356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:09:59.835763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.012835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1002/2003] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:09:59 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:00.018419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.036617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5e0eb-c27f-43c4-9b0a-9cfb757fa60c None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.136283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.138078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.138507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.139002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.140953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.146357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.237654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1002/2004] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:00 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:00.243023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.254853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956022-c75f-4e79-97cc-b8690e56373e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.260051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.260739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.261023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.261302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.262136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.263750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.278474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1003/2005] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:00.281352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.295720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad54fd2-e495-4f6d-97d1-3ae693289d97 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.304733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.306368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.306885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.307393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] PATH_INFO: `/v3/projects/4d8b6613a1864044a75e77703b607ab5/users/ada5237907a642a18ecbc1efd6296100/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.327828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.332259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:00.350848 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8b6613a1864044a75e77703b607ab5, user_id=ada5237907a642a18ecbc1efd6296100, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.351854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a9fd-f08b-4b8d-bea8-00f29dc0b576 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.363137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.368716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.370490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.370490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.370490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] PATH_INFO: `/v3/projects/353968dbddac4fc6828ffc518e5d6ab4` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.372223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353968dbddac4fc6828ffc518e5d6ab4)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.374926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.491473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1003/2006] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:00 2022] PUT /identity/v3/projects/4d8b6613a1864044a75e77703b607ab5/users/ada5237907a642a18ecbc1efd6296100/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:00.492366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.495822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:00.509410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353968dbddac4fc6828ffc518e5d6ab4', 'request_id': 'req-2e7eda9e-768d-4973-a6ed-d60cd81bb577'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.516244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353968dbddac4fc6828ffc518e5d6ab4', 'request_id': 'req-2e7eda9e-768d-4973-a6ed-d60cd81bb577'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.523816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353968dbddac4fc6828ffc518e5d6ab4', 'request_id': 'req-2e7eda9e-768d-4973-a6ed-d60cd81bb577'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.567456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b4d0-c010-4308-a801-0ec88653b6a1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.600927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] The token cache is being invalidate because project 353968dbddac4fc6828ffc518e5d6ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:00.601500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.602261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.603973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1004/2007] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:00 2022] DELETE /identity/v3/projects/353968dbddac4fc6828ffc518e5d6ab4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:00.604829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.606323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:00.629770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.630666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.631024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.631406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] PATH_INFO: `/v3/projects/4abb6edae5dc44c4b4d34d06dd73b7ea` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.632932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abb6edae5dc44c4b4d34d06dd73b7ea)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.634994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.682648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7eda9e-768d-4973-a6ed-d60cd81bb577 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.688390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.689054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.689338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.689617 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.690344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.692860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.702602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1005/2008] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:00.703385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.707863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:00.720848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c846-5d35-4c58-a042-7bad484731aa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.725757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.726599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.727135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.727416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] PATH_INFO: `/v3/users/6690d98bdf254dc699d5433954872126` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.728638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6690d98bdf254dc699d5433954872126)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.730531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.780776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abb6edae5dc44c4b4d34d06dd73b7ea', 'request_id': 'req-2cab19e6-256c-4add-b0ac-7280cce1af67'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.788488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abb6edae5dc44c4b4d34d06dd73b7ea', 'request_id': 'req-2cab19e6-256c-4add-b0ac-7280cce1af67'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.881879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abb6edae5dc44c4b4d34d06dd73b7ea', 'request_id': 'req-2cab19e6-256c-4add-b0ac-7280cce1af67'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.896751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] The token cache is being invalidate because project 4abb6edae5dc44c4b4d34d06dd73b7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:00.897138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.898102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.900719 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1004/2009] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:00 2022] DELETE /identity/v3/projects/4abb6edae5dc44c4b4d34d06dd73b7ea => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:00.902246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:00.907284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:00.972615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab19e6-256c-4add-b0ac-7280cce1af67 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:00.977693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e2cae-9963-47ff-9697-62909a1618a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:00.978593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2cae-9963-47ff-9697-62909a1618a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.978887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2cae-9963-47ff-9697-62909a1618a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.979205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e2cae-9963-47ff-9697-62909a1618a4 admin admin] PATH_INFO: `/v3/projects/4d8b6613a1864044a75e77703b607ab5/users/ada5237907a642a18ecbc1efd6296100/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:00.981275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2cae-9963-47ff-9697-62909a1618a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8b6613a1864044a75e77703b607ab5, user_id=ada5237907a642a18ecbc1efd6296100, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:00.985947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e2cae-9963-47ff-9697-62909a1618a4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:00.987284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6690d98bdf254dc699d5433954872126'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.989190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6690d98bdf254dc699d5433954872126'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:00.995924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1005/2010] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:00 2022] PUT /identity/v3/projects/4d8b6613a1864044a75e77703b607ab5/users/ada5237907a642a18ecbc1efd6296100/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:00.997317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb166d9-1adf-4e5f-83d0-1b948e811a8d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:00.997619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb166d9-1adf-4e5f-83d0-1b948e811a8d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:00.997899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb166d9-1adf-4e5f-83d0-1b948e811a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.006628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6690d98bdf254dc699d5433954872126'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:01.018434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1fb166d9-1adf-4e5f-83d0-1b948e811a8d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:01.020493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1fb166d9-1adf-4e5f-83d0-1b948e811a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:01.021164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6690d98bdf254dc699d5433954872126'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:01.022656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a3f84c73-94a5-40d3-bc14-07dff38b5442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6690d98bdf254dc699d5433954872126'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:01.086360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1006/2011] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:01.088174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.088465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.088742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.108994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1006/2012] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:00 2022] DELETE /identity/v3/users/6690d98bdf254dc699d5433954872126 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:01.110682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.110975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.111254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.122143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] MFA Rules not processed for user `ada5237907a642a18ecbc1efd6296100`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:01.123454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:01.133907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:01.133907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:01.211032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1007/2013] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:01.215131 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.227218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1007/2014] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:01.232249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59721e3-b4b3-412a-9ed9-c8d1df49467b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.233001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.233700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.233982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.234274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.235044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:01.235356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.237051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.240465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.242849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:01.252420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1008/2015] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:01.259089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.270212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f37a69-33ce-4225-a627-1cb8f8129a80 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.276909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.277574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.282037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.282037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.282746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.285615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.317449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36ea06-5923-4788-98e9-f7d931a87ba0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.331870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.333068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.334370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.334897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.349980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.351615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.367914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1008/2016] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:01.484580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1009/2017] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:01 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:01.486506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.509874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6787a3-b483-4d6b-9730-c1a60e49377c service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.625848 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.626683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.626974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.627257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.628180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.631516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.758593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1009/2018] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:01 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:01.764315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.772911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.774865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:01.792521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22febecc-ba66-4f93-8f3c-62a46d7ade4b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.797932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.798962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.799970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.800107 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] PATH_INFO: `/v3/projects/8dc9ad0f8072446cbba377f5593f1356` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.802247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc9ad0f8072446cbba377f5593f1356)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.804219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893557f1-e759-415f-804b-fb39197d4f5b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.804358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.817730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.818774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.819145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.819521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.820570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.822806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.839761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1010/2019] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:01.841104 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.859047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437510f7-bc87-48ba-8456-691e57ff3970 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.870331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.871980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.872591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.872909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.876592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.876592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.889291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1011/2020] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:01.893173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:01.912778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec2b83-bf30-4860-89db-5823300daeed admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:01.921797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5081ce1-7db8-431c-a8e2-a67bc02058c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:01.923436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5081ce1-7db8-431c-a8e2-a67bc02058c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:01.924082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5081ce1-7db8-431c-a8e2-a67bc02058c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:01.924633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5081ce1-7db8-431c-a8e2-a67bc02058c6 admin admin] PATH_INFO: `/v3/projects/3c4477ea11f04d2ba34fc9152e177995/users/2f232397751b434fbb5a80122857121d/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:01.948862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5081ce1-7db8-431c-a8e2-a67bc02058c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4477ea11f04d2ba34fc9152e177995, user_id=2f232397751b434fbb5a80122857121d, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:01.954572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5081ce1-7db8-431c-a8e2-a67bc02058c6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:01.987734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc9ad0f8072446cbba377f5593f1356', 'request_id': 'req-38f312bf-3ba9-47e4-9f2c-8934e011e51b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:01.994440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc9ad0f8072446cbba377f5593f1356', 'request_id': 'req-38f312bf-3ba9-47e4-9f2c-8934e011e51b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:02.087512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc9ad0f8072446cbba377f5593f1356', 'request_id': 'req-38f312bf-3ba9-47e4-9f2c-8934e011e51b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:02.093640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1012/2021] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:01 2022] PUT /identity/v3/projects/3c4477ea11f04d2ba34fc9152e177995/users/2f232397751b434fbb5a80122857121d/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:02.104756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.105051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.105498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.107472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] The token cache is being invalidate because project 8dc9ad0f8072446cbba377f5593f1356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:02.107968 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:02.108809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-38f312bf-3ba9-47e4-9f2c-8934e011e51b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:02.111074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1010/2022] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:01 2022] DELETE /identity/v3/projects/8dc9ad0f8072446cbba377f5593f1356 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:02.117381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a84ec8-bac4-4592-876f-94a2a0c8b51a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.118019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a84ec8-bac4-4592-876f-94a2a0c8b51a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.118507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a84ec8-bac4-4592-876f-94a2a0c8b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.143183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-79a84ec8-bac4-4592-876f-94a2a0c8b51a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:02.146134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-79a84ec8-bac4-4592-876f-94a2a0c8b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:02.151692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] MFA Rules not processed for user `2f232397751b434fbb5a80122857121d`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:02.152930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:02.211039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1011/2023] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:02.219776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.220108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.220394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.222298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1013/2024] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:02.243497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:02.244884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:02.249196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.250712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:02.258077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1012/2025] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:02.260194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.270479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcb3cc-08c9-4d4e-aaa0-c91656a56e1b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.276352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.277505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.277798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.278126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.278869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:02.279184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.280877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.294238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1013/2026] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:02.299276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.310478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f4d6d-b69c-4ea6-afb4-3a5cd49325cc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.314073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b39d2d-3d38-4125-9b36-b3fad6f907dc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.315372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.319818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.319818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.319818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.319818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.320204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.320204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.320204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.320204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.320521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.329217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.330622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.340145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1014/2027] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:02.411497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1014/2028] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:02 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:02.424273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.430380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fa2e7-2160-4bff-b3b3-45cadec04cfa service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.500930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.501609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.501948 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.502233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.502932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.505790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.602906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1015/2029] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:02 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:02.606870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.619173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6a3aa-b0c3-4a71-ba9e-0ae604f8fb5d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.624229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.624917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.625205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.625491 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.626234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.627879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.639434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1015/2030] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:02.644265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.654907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b9cca-f33c-4393-9432-a1f0363a7748 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.667614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efa1d6-27b9-48a0-a9f2-38202edfd53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.667614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efa1d6-27b9-48a0-a9f2-38202edfd53d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.667614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efa1d6-27b9-48a0-a9f2-38202edfd53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.667614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efa1d6-27b9-48a0-a9f2-38202edfd53d admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.668322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efa1d6-27b9-48a0-a9f2-38202edfd53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.668322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efa1d6-27b9-48a0-a9f2-38202edfd53d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.678117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1016/2031] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:02.684558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:02.701976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6e3fa-3a3e-4339-90ca-e87deb447d03 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:02.709283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:02.710375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.710798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.711266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] PATH_INFO: `/v3/projects/c668381f1e964a3782c1c182a07dde35/users/829dd288319544c5b200ec6b302f8475/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.736280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c668381f1e964a3782c1c182a07dde35, user_id=829dd288319544c5b200ec6b302f8475, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:02.742078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:02.825189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1016/2032] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:02 2022] PUT /identity/v3/projects/c668381f1e964a3782c1c182a07dde35/users/829dd288319544c5b200ec6b302f8475/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:02.836051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:02.836426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:02.836787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:02.885439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] MFA Rules not processed for user `829dd288319544c5b200ec6b302f8475`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:02.887466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:03.026835 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1017/2033] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:03.116798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:03.199458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c00c5-cef1-4f24-a5ee-becb35f17c10 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:03.206254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:03.207746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:03.208252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:03.208550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:03.218272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:03.228214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:03.231880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1017/2034] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:03.314870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:03.319705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:03.336818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb20ed-a30b-45d5-9af9-cf1dcd658104 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:03.343118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:03.344223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:03.344728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:03.345112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:03.348397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:03.432976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:03.435787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056eea-9bdb-43f8-9b18-4b6f6bbfd695 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:03.449690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1018/2035] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:05.694880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:05.696498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:05.762973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf28a43-7b3d-4197-baca-45b518376c59 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:05.767573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:05.768471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:05.768808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:05.769171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] PATH_INFO: `/v3/users/2f232397751b434fbb5a80122857121d` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:05.770979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f232397751b434fbb5a80122857121d)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:05.772963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:06.037786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f232397751b434fbb5a80122857121d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:06.044580 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f232397751b434fbb5a80122857121d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:06.056940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f232397751b434fbb5a80122857121d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:06.058138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f232397751b434fbb5a80122857121d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:06.058341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f232397751b434fbb5a80122857121d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:06.137868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1018/2036] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:05 2022] DELETE /identity/v3/users/2f232397751b434fbb5a80122857121d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:06.142456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:06.142979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:06.143075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:06.161142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:06.162326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:06.222930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1019/2037] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:06.233008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:06.235053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:06.307938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3be8a-9edb-46f1-9e32-bb5b3a410b4b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:06.312689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b5cbc-5dbb-4ad5-9aa7-49c2797324f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:06.313383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b5cbc-5dbb-4ad5-9aa7-49c2797324f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:06.313721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b5cbc-5dbb-4ad5-9aa7-49c2797324f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:06.314006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b5cbc-5dbb-4ad5-9aa7-49c2797324f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:06.326578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b5cbc-5dbb-4ad5-9aa7-49c2797324f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:06.328512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b5cbc-5dbb-4ad5-9aa7-49c2797324f8 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:06.343996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1019/2038] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:06.991256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:06.992782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:07.006168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038ed27-b093-45ac-9a91-ce01e020ad45 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.011448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.012356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.012640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.012915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] PATH_INFO: `/v3/projects/3c4477ea11f04d2ba34fc9152e177995` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.014145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4477ea11f04d2ba34fc9152e177995)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.016245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.184710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4477ea11f04d2ba34fc9152e177995', 'request_id': 'req-08462da7-398a-467e-8134-fac450e04f48'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:07.191599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4477ea11f04d2ba34fc9152e177995', 'request_id': 'req-08462da7-398a-467e-8134-fac450e04f48'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:07.196761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4477ea11f04d2ba34fc9152e177995', 'request_id': 'req-08462da7-398a-467e-8134-fac450e04f48'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:07.277221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] The token cache is being invalidate because project 3c4477ea11f04d2ba34fc9152e177995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:07.277636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:07.279247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-08462da7-398a-467e-8134-fac450e04f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:07.281098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1020/2039] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:06 2022] DELETE /identity/v3/projects/3c4477ea11f04d2ba34fc9152e177995 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:07.286448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.286967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.287058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.330856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:07.332974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:07.410372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1020/2040] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:07.418984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.421337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.421337 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.445175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:07.446678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:07.457084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1021/2041] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:07.460226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:07.471273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9874a-a59e-4323-8cf2-88c639ae0cce None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.480997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.485806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.485806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.485806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.485806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:07.485806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.485806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.501031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1021/2042] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:07.506935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:07.517260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a571d-b157-4a17-ad1c-5c3d7220b73d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.523186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.523964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.524492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.525132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.525803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.527928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.644196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1022/2043] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:07 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:07.648379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:07.658636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64ecb1-d794-4ed4-a874-68921114566a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.725879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:07.728494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:07.792523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.799214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.799214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.799214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.799214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.799214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.817414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8b981-cfec-43e5-ba69-a9d3982eae37 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.823013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.824025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.824380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.824727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] PATH_INFO: `/v3/users/38d1261b735140149620bb5389d9f8c4` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.826095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d1261b735140149620bb5389d9f8c4)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.828220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.887932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1022/2044] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:07 2022] POST /identity/v3/users => generated 281 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:07.892375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:07.904336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fce3f-8910-404a-93f9-acdfd0d3ebfd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.910188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.913724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.913724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.913724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.913724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.914268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.925171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1023/2045] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:07.930081 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:07.949340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24eab1-b7a7-4007-af0b-ff64d9d44447 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:07.959686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:07.960891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:07.961401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:07.961906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:07.963324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:07.966532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:07.981309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1024/2046] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:07.985995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:08.006729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d54e32-b43f-4ed7-96ae-dbe21ac19e45 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:08.014302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6d841-4b48-4e5a-898e-e4f253345c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:08.015911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6d841-4b48-4e5a-898e-e4f253345c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:08.016444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6d841-4b48-4e5a-898e-e4f253345c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:08.016955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6d841-4b48-4e5a-898e-e4f253345c9b admin admin] PATH_INFO: `/v3/projects/4302f076c1c44015b2607dccd5813359/users/62e32b95f418402e9aa6ab9849421836/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:08.041391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6d841-4b48-4e5a-898e-e4f253345c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4302f076c1c44015b2607dccd5813359, user_id=62e32b95f418402e9aa6ab9849421836, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:08.044212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6d841-4b48-4e5a-898e-e4f253345c9b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:08.073636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d1261b735140149620bb5389d9f8c4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:08.074493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d1261b735140149620bb5389d9f8c4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:08.083611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d1261b735140149620bb5389d9f8c4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:08.098745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d1261b735140149620bb5389d9f8c4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:08.099969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d2f025cc-a942-4b24-8db9-df1aebe764df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d1261b735140149620bb5389d9f8c4'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:08.119934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1025/2047] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:07 2022] PUT /identity/v3/projects/4302f076c1c44015b2607dccd5813359/users/62e32b95f418402e9aa6ab9849421836/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:08.136358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:08.139068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:08.139068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:08.178862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1023/2048] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:07 2022] DELETE /identity/v3/users/38d1261b735140149620bb5389d9f8c4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:08.183918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] MFA Rules not processed for user `62e32b95f418402e9aa6ab9849421836`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:08.184190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:08.184549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:08.185013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:08.185921 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:08.216709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:08.220427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:08.272410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1026/2049] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:08.285538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:08.287232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:08.342246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1024/2050] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:08.370303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:08.372302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:08.378034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b066e1-efff-4439-846c-9d0d2fee837d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:08.390292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:08.392387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:08.392567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:08.393482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:08.422807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:08.424603 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:08.439926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1027/2051] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:08.470064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f030403-2467-48cd-b251-85501a695ed5 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:08.477482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:08.478158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:08.478460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:08.478736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:08.506581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:08.506581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:08.517695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1025/2052] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:08.999341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:09.002178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:09.030628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fef6b-4833-43b0-b66e-bbb126afa33e service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:09.060293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:09.061191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:09.061516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:09.061814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] PATH_INFO: `/v3/projects/b20bd0883bfe4d5b87e921f2277d25a7` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:09.063205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20bd0883bfe4d5b87e921f2277d25a7)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:09.066085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:09.225910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20bd0883bfe4d5b87e921f2277d25a7', 'request_id': 'req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.235885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20bd0883bfe4d5b87e921f2277d25a7', 'request_id': 'req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.349648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20bd0883bfe4d5b87e921f2277d25a7', 'request_id': 'req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.386759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] The token cache is being invalidate because project b20bd0883bfe4d5b87e921f2277d25a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:09.387277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.388757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1b0a957f-4c49-4835-97c0-3c9a6e62acc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.390607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1028/2053] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:08 2022] DELETE /identity/v3/projects/b20bd0883bfe4d5b87e921f2277d25a7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:09.396415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:09.418268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2910cbd-7790-451b-bec3-1e3728255fde service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:09.500039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:09.500910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:09.501275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:09.501619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] PATH_INFO: `/v3/users/27267d09386b46ec8c6110dcc7edadf7` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:09.502877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27267d09386b46ec8c6110dcc7edadf7)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:09.504945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:09.734705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27267d09386b46ec8c6110dcc7edadf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.735395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27267d09386b46ec8c6110dcc7edadf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.742584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27267d09386b46ec8c6110dcc7edadf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.755759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27267d09386b46ec8c6110dcc7edadf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.756633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27267d09386b46ec8c6110dcc7edadf7'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:09.853001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1026/2054] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:09 2022] DELETE /identity/v3/users/27267d09386b46ec8c6110dcc7edadf7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:10.322891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:10.322891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:10.322891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:10.333789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] MFA Rules not processed for user `70516383f3b14d5283462803cac26d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:10.335470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:10.416439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1029/2055] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:10.429135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:10.432003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:10.508612 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:10.510837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:10.547482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87a023-7846-49d0-beb1-4f9c81f81f9e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:10.554958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:10.556138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:10.556618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:10.557118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] PATH_INFO: `/v3/projects/4bab49c4c5844982948614f72e10f3e7` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:10.558763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bab49c4c5844982948614f72e10f3e7)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:10.561921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:10.667014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675b284-b3c0-44a3-8a78-4952c6a521f4 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:10.675370 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:10.678275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:10.678801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:10.679440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] PATH_INFO: `/v3/users/94dda2419e2242cc8102a08ad4c8c0b4` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:10.681678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dda2419e2242cc8102a08ad4c8c0b4)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:10.685358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:10.710132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bab49c4c5844982948614f72e10f3e7', 'request_id': 'req-9acf0ab3-6d20-4261-8961-f303bba69947'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.738715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bab49c4c5844982948614f72e10f3e7', 'request_id': 'req-9acf0ab3-6d20-4261-8961-f303bba69947'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.772597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bab49c4c5844982948614f72e10f3e7', 'request_id': 'req-9acf0ab3-6d20-4261-8961-f303bba69947'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.886628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] The token cache is being invalidate because project 4bab49c4c5844982948614f72e10f3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:10.889111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.889111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.892544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1027/2056] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:10 2022] DELETE /identity/v3/projects/4bab49c4c5844982948614f72e10f3e7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:10.893430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:10.895105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:10.932455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dda2419e2242cc8102a08ad4c8c0b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.947053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dda2419e2242cc8102a08ad4c8c0b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.957638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dda2419e2242cc8102a08ad4c8c0b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.958765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dda2419e2242cc8102a08ad4c8c0b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.959430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a9d38aed-7293-4db1-afda-a180dede9102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dda2419e2242cc8102a08ad4c8c0b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:10.984228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf0ab3-6d20-4261-8961-f303bba69947 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:10.989609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:10.990256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:10.990682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:10.990965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:10.993597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:11.038372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1030/2057] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:10 2022] DELETE /identity/v3/users/94dda2419e2242cc8102a08ad4c8c0b4 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:11.041344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.041793 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.042343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.069152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:11.070708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:11.084467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.086513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88656162-228a-4ad8-9711-e57b524787a0 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.106032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1028/2058] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:11.170211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1031/2059] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:11.172626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.172916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.173283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.202032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:11.203827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:11.219280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1029/2060] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:11.224123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.236251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e89df-f168-423f-99ae-6a43147b5cc8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.245331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.246494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.246494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.246714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.247775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:11.248198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.249919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.263926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1032/2061] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:11.269992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.282364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6c4d0-fd92-491e-9877-6db616a61a8d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.287850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.288827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.289034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.289318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.290174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.292099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.435863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.441745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1030/2062] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:11 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:11.443991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.445468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:11.461263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae282f-5d53-4959-b0c3-afd07d6beefe admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.544592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.545898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.546412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.547015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] PATH_INFO: `/v3/projects/784d5ee9775c49d6a4127a0bea10323c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.548838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=784d5ee9775c49d6a4127a0bea10323c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.568352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.574585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd265a3-4ea1-430a-9c3b-47ed2d04f3f4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.580183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.581473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.582118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.582500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.583932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.586474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.732861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1031/2063] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:11 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:11.738534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.750231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784d5ee9775c49d6a4127a0bea10323c', 'request_id': 'req-268a717a-7f68-4ef4-b150-0111e0efdfcc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:11.751600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c812c-d1f6-4e44-8ea3-c9b523ae5e04 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.757927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784d5ee9775c49d6a4127a0bea10323c', 'request_id': 'req-268a717a-7f68-4ef4-b150-0111e0efdfcc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:11.840667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.841357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.841642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.841922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.842669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.844466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.855380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1032/2064] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:11.859514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.875999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33388b7-e9e6-4b19-9f7e-bb3187685227 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.885569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.886527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.886980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.887500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.888989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:11.892415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784d5ee9775c49d6a4127a0bea10323c', 'request_id': 'req-268a717a-7f68-4ef4-b150-0111e0efdfcc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:11.892901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:11.920039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1033/2065] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:11.920553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] The token cache is being invalidate because project 784d5ee9775c49d6a4127a0bea10323c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:11.921306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:11.922332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-268a717a-7f68-4ef4-b150-0111e0efdfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:11.924568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:11.925270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1033/2066] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:11 2022] DELETE /identity/v3/projects/784d5ee9775c49d6a4127a0bea10323c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:11.928021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:11.932074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4b4ce-ddaa-4b4b-8af4-58ef15d9c519 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.936041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4b4ce-ddaa-4b4b-8af4-58ef15d9c519 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.937229 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4b4ce-ddaa-4b4b-8af4-58ef15d9c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.977606 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ea2cd-6d14-4793-99a5-cf43bc8fcc9d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:11.985113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894a956-3ae3-4fc7-afbc-7d93d2c7026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:11.986320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a956-3ae3-4fc7-afbc-7d93d2c7026a admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:11.986787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a956-3ae3-4fc7-afbc-7d93d2c7026a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:11.987965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894a956-3ae3-4fc7-afbc-7d93d2c7026a admin admin] PATH_INFO: `/v3/projects/b2f3b6497f064059bc4670f6ad91fa66/users/ccdc151d95054a1ab00b8ef5d2c43094/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:11.988704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-42c4b4ce-ddaa-4b4b-8af4-58ef15d9c519 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:11.989994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-42c4b4ce-ddaa-4b4b-8af4-58ef15d9c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:11.999494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1034/2067] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:12.009185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894a956-3ae3-4fc7-afbc-7d93d2c7026a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f3b6497f064059bc4670f6ad91fa66, user_id=ccdc151d95054a1ab00b8ef5d2c43094, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.009399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.009587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.009873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.013106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894a956-3ae3-4fc7-afbc-7d93d2c7026a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.028846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:12.030362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:12.040529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1035/2068] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:12.044822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.054584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc7faa-3c67-43e8-9002-17d06c6d5875 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.059421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.060119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.060402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.060681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.061409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:12.066908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.066908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.080750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1036/2069] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:10:12.086126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.104110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad9d8a-e858-4b2d-90ae-ecf8fc1491d0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.110464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.111366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.111633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.112017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.112922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.114889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.151567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1034/2070] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:11 2022] PUT /identity/v3/projects/b2f3b6497f064059bc4670f6ad91fa66/users/ccdc151d95054a1ab00b8ef5d2c43094/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:12.164179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.164561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.164894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.197091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] MFA Rules not processed for user `ccdc151d95054a1ab00b8ef5d2c43094`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:12.198402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:12.244456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1037/2071] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:12.249087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.265976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1035/2072] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:12.270432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.325094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403398c0-e24c-47eb-a9bd-c2ca17aec6eb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.329970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.330688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.331168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.331463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.332281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.334109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.350330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b163b0a-72a7-4dda-9378-9ba2130767ce None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.364078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.365286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.365802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.366318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.367681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.371524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.461377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1038/2073] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:12.465653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.490202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302f809-2524-48d3-b37d-1ec7a872ae47 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.496678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.497340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.497340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.497531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.498214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.499824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.511632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1039/2074] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:12.515586 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.526497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45f40-cc8d-4701-836f-0338b7128acd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.531384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.532137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.532401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.532704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.533413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.534935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1036/2075] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:12.536010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.539105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.563480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1040/2076] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:12.564931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.576651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e2dbe-193a-4c4c-82fd-c3dae5d36af0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.618550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbb231-6262-437d-8b12-f851a4c3d20b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.625111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.625843 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.626294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.626627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.627282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.630996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.650330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3c0e6-f192-4c64-b7ba-a5c353cbdaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.651220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c0e6-f192-4c64-b7ba-a5c353cbdaeb admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.651507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c0e6-f192-4c64-b7ba-a5c353cbdaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.651789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3c0e6-f192-4c64-b7ba-a5c353cbdaeb admin admin] PATH_INFO: `/v3/projects/8ef8a0b8828d4a38a7f8a9465fa9fbaf/users/5adf4837cc254e1a951dda183d795606/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.669087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3c0e6-f192-4c64-b7ba-a5c353cbdaeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef8a0b8828d4a38a7f8a9465fa9fbaf, user_id=5adf4837cc254e1a951dda183d795606, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.671776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3c0e6-f192-4c64-b7ba-a5c353cbdaeb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.763388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1037/2077] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:12.767382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.779898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76b924-2187-4583-9575-2e41776f0662 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.786463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1041/2078] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:12 2022] PUT /identity/v3/projects/8ef8a0b8828d4a38a7f8a9465fa9fbaf/users/5adf4837cc254e1a951dda183d795606/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:12.793900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.795077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.795557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.823438 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:12.825662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:12.873857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.874423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.874702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.874977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.875720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.877362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.889437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1038/2079] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:12.892451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.903701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbb9d4-60e2-4463-9062-f5d101065567 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.906535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1042/2080] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:12.912639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.913746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.914105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.914646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.915491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.917316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:12.920732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.926545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:12.928774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1039/2081] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:12.934680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:12.946757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e0455-be55-4733-959a-fa8b32b4d638 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:12.961766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:12.963631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:12.964188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:12.964805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] PATH_INFO: `/v3/projects/3093c3ddb1fe4bff96d3cddd01903822/users/bf1f37a83f4d44f2be15d12fd50ba2ec/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:12.991177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3093c3ddb1fe4bff96d3cddd01903822, user_id=bf1f37a83f4d44f2be15d12fd50ba2ec, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:12.996262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:13.025781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029531d-a1aa-4205-a7e7-1a227b1695a0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:13.038747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9764b8-a76b-4816-aea9-cc81a8b1f9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:13.038747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9764b8-a76b-4816-aea9-cc81a8b1f9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:13.038747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9764b8-a76b-4816-aea9-cc81a8b1f9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:13.038747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9764b8-a76b-4816-aea9-cc81a8b1f9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:13.056150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9764b8-a76b-4816-aea9-cc81a8b1f9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:13.057895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9764b8-a76b-4816-aea9-cc81a8b1f9f1 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:13.083869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1043/2082] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:13.115942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1040/2083] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:12 2022] PUT /identity/v3/projects/3093c3ddb1fe4bff96d3cddd01903822/users/bf1f37a83f4d44f2be15d12fd50ba2ec/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:13.126788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:13.128276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:13.128466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:13.171315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] MFA Rules not processed for user `bf1f37a83f4d44f2be15d12fd50ba2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:13.172667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:13.276031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1044/2084] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:13.278523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:13.504603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28486206-ad08-48ae-bc08-f59d32b4a1df admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:13.510603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:13.512238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:13.512570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:13.513040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:13.516602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:13.519815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:13.670888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1041/2085] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:13 2022] POST /identity/v3/projects => generated 379 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:13.675024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:13.686310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29743d-934f-4c27-b4d3-272f21f51d60 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:13.758035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:13.759044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:13.759335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:13.759624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:13.760404 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:13.762428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:13.884548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1045/2086] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:13 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:13.885715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:13.899163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc958-399a-4191-a589-911ba40c4291 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:13.922200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:13.922946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:13.923230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:13.923529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:13.931296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:13.936633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:13.954067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1042/2087] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:13.959425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:13.969526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c014682-1752-4b32-b600-c9c3b4cff96d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:13.974864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:13.975778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:13.976085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:13.976365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] PATH_INFO: `/v3/projects/a712697b469a4b83ba43f151642d9077/users/440c5947cd4d47e19854efb37467c44f/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:13.993171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a712697b469a4b83ba43f151642d9077, user_id=440c5947cd4d47e19854efb37467c44f, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:13.995914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:14.098234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1046/2088] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:13 2022] PUT /identity/v3/projects/a712697b469a4b83ba43f151642d9077/users/440c5947cd4d47e19854efb37467c44f/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:14.102560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:14.114053 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807a684-90ac-4058-9cf5-6b4d3f09d1a4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:14.198212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac148496-cef6-47ea-8971-7cba5e4641b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:14.199072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148496-cef6-47ea-8971-7cba5e4641b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:14.199352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148496-cef6-47ea-8971-7cba5e4641b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:14.199709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac148496-cef6-47ea-8971-7cba5e4641b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:14.200550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac148496-cef6-47ea-8971-7cba5e4641b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:14.202142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac148496-cef6-47ea-8971-7cba5e4641b5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:14.214125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1043/2089] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:14.218467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:14.229546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7992368-292a-4a56-9766-0f974feaca3c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:14.234233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:14.235104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:14.235386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:14.235664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] PATH_INFO: `/v3/projects/a712697b469a4b83ba43f151642d9077/users/440c5947cd4d47e19854efb37467c44f/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:14.238188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a712697b469a4b83ba43f151642d9077, user_id=440c5947cd4d47e19854efb37467c44f, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:14.240953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:14.251641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1047/2090] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:14 2022] PUT /identity/v3/projects/a712697b469a4b83ba43f151642d9077/users/440c5947cd4d47e19854efb37467c44f/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:14.262568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:14.262868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:14.263155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:14.293665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] MFA Rules not processed for user `440c5947cd4d47e19854efb37467c44f`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:14.295654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:14.449501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1044/2091] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:14.530949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:14.532765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:14.610325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a836a-c532-429b-9a69-65a67f2c5e36 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:14.614339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:14.615642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:14.615642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:14.615642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:14.628446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:14.630070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:14.642502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1048/2092] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:14.890215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:14.909161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f497c-4527-451b-bd54-6dd79a219cef None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:14.914294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d4e8-1319-4e9f-8910-20b43719d1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:14.915341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d4e8-1319-4e9f-8910-20b43719d1bc service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:14.915813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d4e8-1319-4e9f-8910-20b43719d1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:14.916219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d4e8-1319-4e9f-8910-20b43719d1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:15.009037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d4e8-1319-4e9f-8910-20b43719d1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:15.010671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d4e8-1319-4e9f-8910-20b43719d1bc service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:15.025249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1045/2093] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:16.867676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:16.867676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:16.964255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15b88d-09cf-47f8-877b-baa8a79115f0 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:16.969197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:16.970175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:16.970634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:16.970912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] PATH_INFO: `/v3/users/b677563dc83b40c692811c298ae1f1c6` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:16.972217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b677563dc83b40c692811c298ae1f1c6)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:16.974250 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:17.189671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b677563dc83b40c692811c298ae1f1c6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:17.198599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b677563dc83b40c692811c298ae1f1c6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:17.214614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b677563dc83b40c692811c298ae1f1c6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:17.215225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b677563dc83b40c692811c298ae1f1c6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:17.216019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b677563dc83b40c692811c298ae1f1c6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:17.321628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1049/2094] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:16 2022] DELETE /identity/v3/users/b677563dc83b40c692811c298ae1f1c6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:17.326548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:17.327074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:17.327197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:17.351364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:17.361997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:17.447137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1046/2095] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:17.458419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:17.460072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:17.551359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e180cd-064a-41b1-91d8-d4e89d1b431c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:17.556642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:17.557365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:17.558091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:17.558091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:17.570571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:17.572360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:17.584873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1050/2096] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:18.231642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:18.233402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:18.262241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac47391-355a-4fe7-8e55-02147517f757 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:18.268936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:18.270111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:18.270490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:18.270864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] PATH_INFO: `/v3/projects/bfaef58af71e460ca9ec6cd1be58ae58` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:18.272994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfaef58af71e460ca9ec6cd1be58ae58)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:18.274941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:18.435341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfaef58af71e460ca9ec6cd1be58ae58', 'request_id': 'req-97099f5f-08c5-47da-8d16-53e1f53726d0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.442921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfaef58af71e460ca9ec6cd1be58ae58', 'request_id': 'req-97099f5f-08c5-47da-8d16-53e1f53726d0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.448718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfaef58af71e460ca9ec6cd1be58ae58', 'request_id': 'req-97099f5f-08c5-47da-8d16-53e1f53726d0'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.542929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] The token cache is being invalidate because project bfaef58af71e460ca9ec6cd1be58ae58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:18.543163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.543868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.545745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1047/2097] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:18 2022] DELETE /identity/v3/projects/bfaef58af71e460ca9ec6cd1be58ae58 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:18.549884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:18.560676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0021db-10cb-4f32-9f30-c95e9fc3cd57 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:18.655765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:18.656720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:18.657497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:18.657790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] PATH_INFO: `/v3/users/d22f2c43f3524c879c7f55b44ebf1f92` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:18.660096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22f2c43f3524c879c7f55b44ebf1f92)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:18.662288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:18.954618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22f2c43f3524c879c7f55b44ebf1f92'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.962780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22f2c43f3524c879c7f55b44ebf1f92'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.981704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22f2c43f3524c879c7f55b44ebf1f92'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.983190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22f2c43f3524c879c7f55b44ebf1f92'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:18.983751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22f2c43f3524c879c7f55b44ebf1f92'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:19.088906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1051/2098] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:18 2022] DELETE /identity/v3/users/d22f2c43f3524c879c7f55b44ebf1f92 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:19.586753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:19.589582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:19.607521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97099f5f-08c5-47da-8d16-53e1f53726d0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:19.688196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:19.689313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:19.689596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:19.689901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] PATH_INFO: `/v3/projects/07b6ae38729e4269b8fa38249361682f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:19.691466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b6ae38729e4269b8fa38249361682f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:19.700560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:19.703145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:19.704575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:19.739036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14796f73-6b76-4ede-acee-4b7d54f4187a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:19.751757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:19.752843 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:19.753519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:19.753819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] PATH_INFO: `/v3/users/829dd288319544c5b200ec6b302f8475` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:19.756498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829dd288319544c5b200ec6b302f8475)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:19.765319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:19.823940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b6ae38729e4269b8fa38249361682f', 'request_id': 'req-fc73a893-bb52-4406-9244-13be7f0f8e67'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:19.831003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b6ae38729e4269b8fa38249361682f', 'request_id': 'req-fc73a893-bb52-4406-9244-13be7f0f8e67'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:19.837103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b6ae38729e4269b8fa38249361682f', 'request_id': 'req-fc73a893-bb52-4406-9244-13be7f0f8e67'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:19.944298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] The token cache is being invalidate because project 07b6ae38729e4269b8fa38249361682f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:19.944870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:19.945841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:19.949003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1048/2099] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:19 2022] DELETE /identity/v3/projects/07b6ae38729e4269b8fa38249361682f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:19.953015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:19.955335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:20.003639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829dd288319544c5b200ec6b302f8475'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.020901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829dd288319544c5b200ec6b302f8475'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.039496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73a893-bb52-4406-9244-13be7f0f8e67 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:20.046680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:20.048560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:20.049016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:20.050106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] PATH_INFO: `/v3/users/ada5237907a642a18ecbc1efd6296100` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:20.052449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada5237907a642a18ecbc1efd6296100)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:20.054724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:20.055500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829dd288319544c5b200ec6b302f8475'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.058086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829dd288319544c5b200ec6b302f8475'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.059145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e067a54-779e-4686-88ea-3e98ecf09a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829dd288319544c5b200ec6b302f8475'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.125359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1052/2100] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:19 2022] DELETE /identity/v3/users/829dd288319544c5b200ec6b302f8475 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:20.127391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:20.130063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:20.130760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:20.151369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:20.153145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:20.223544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1053/2101] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:20.230479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:20.232108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:20.275561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada5237907a642a18ecbc1efd6296100'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.276318 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada5237907a642a18ecbc1efd6296100'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.286461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada5237907a642a18ecbc1efd6296100'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.299632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada5237907a642a18ecbc1efd6296100'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.300405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada5237907a642a18ecbc1efd6296100'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:20.302458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fab8e8-c4f1-41a6-90b5-378ba6d2c59e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:20.306979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:20.307631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:20.307951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:20.308295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:20.310245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:20.334104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:20.335884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:20.347619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1054/2102] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:20.420055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1049/2103] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:19 2022] DELETE /identity/v3/users/ada5237907a642a18ecbc1efd6296100 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:20.924934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:20.929147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:20.954593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea95908-d0ca-400c-8c27-7c513b303164 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.053362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.054610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.054999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.055469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] PATH_INFO: `/v3/projects/c668381f1e964a3782c1c182a07dde35` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.057204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c668381f1e964a3782c1c182a07dde35)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:21.059315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:21.145306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.146902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:21.162094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78aea-9fa2-48f2-a477-98067576a34b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.167625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.168692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.168902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.169062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] PATH_INFO: `/v3/projects/4d8b6613a1864044a75e77703b607ab5` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.170911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8b6613a1864044a75e77703b607ab5)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:21.172863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:21.201777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c668381f1e964a3782c1c182a07dde35', 'request_id': 'req-af8e16a9-951f-4917-869a-853513575fad'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.212073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c668381f1e964a3782c1c182a07dde35', 'request_id': 'req-af8e16a9-951f-4917-869a-853513575fad'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.361111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8b6613a1864044a75e77703b607ab5', 'request_id': 'req-5f1e23f6-0743-4108-a259-89c564bd01d5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.368594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8b6613a1864044a75e77703b607ab5', 'request_id': 'req-5f1e23f6-0743-4108-a259-89c564bd01d5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.375938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8b6613a1864044a75e77703b607ab5', 'request_id': 'req-5f1e23f6-0743-4108-a259-89c564bd01d5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.383223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c668381f1e964a3782c1c182a07dde35', 'request_id': 'req-af8e16a9-951f-4917-869a-853513575fad'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.399808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] The token cache is being invalidate because project c668381f1e964a3782c1c182a07dde35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:21.400124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.406046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-af8e16a9-951f-4917-869a-853513575fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.408969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1055/2104] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:20 2022] DELETE /identity/v3/projects/c668381f1e964a3782c1c182a07dde35 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:21.415374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862328c6-6fb8-4eca-bb6c-3a8ed09be842 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.415752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862328c6-6fb8-4eca-bb6c-3a8ed09be842 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.416065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862328c6-6fb8-4eca-bb6c-3a8ed09be842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.445831 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-862328c6-6fb8-4eca-bb6c-3a8ed09be842 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:21.447614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-862328c6-6fb8-4eca-bb6c-3a8ed09be842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:21.519713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] The token cache is being invalidate because project 4d8b6613a1864044a75e77703b607ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:21.520071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.520905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5f1e23f6-0743-4108-a259-89c564bd01d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:21.522788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1050/2105] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:21 2022] DELETE /identity/v3/projects/4d8b6613a1864044a75e77703b607ab5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:21.528381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519567f-419b-4282-9b0a-8b6fee9a5acc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.532233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519567f-419b-4282-9b0a-8b6fee9a5acc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.532537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519567f-419b-4282-9b0a-8b6fee9a5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.540327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1056/2106] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:21.551088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.551384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.551670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.562660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f519567f-419b-4282-9b0a-8b6fee9a5acc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:21.564345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f519567f-419b-4282-9b0a-8b6fee9a5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:21.576431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1051/2107] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:21.578657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:21.579925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:21.585626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.586059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.586449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.591860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1057/2108] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:21.598372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.615805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8696e21-ef0e-4883-866a-3297287ac10d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.615998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:21.617300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:21.621467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.623588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.623916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.624204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.625198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:21.625809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:21.635947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:21.636499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1052/2109] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:21.639333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.644918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1058/2110] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:21.649247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.664074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9b2e3-0ffc-43be-b346-1945eb494ba2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.665903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff9362-62a0-4fe4-8654-db79e38cd1b2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.671660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.671660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.671660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.671660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.672125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.672229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:21.672303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.672373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:21.672441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.672630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.673257 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:21.675047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:21.676323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:21.691889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1053/2111] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:21.695709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.708712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8685028-297d-440d-95b2-4cccd9826fa9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.713666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.714332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.714639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.714933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.715668 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:21.717729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:21.837291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1059/2112] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:21.841587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.860507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1054/2113] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:21.866398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:21.949634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89e4af-1828-426e-a47a-382add099c64 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.991724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdade1-0285-4bb6-b815-4f20d48905e1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:21.996707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:21.997390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:21.997688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:21.997983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:21.999017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.000969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.029582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.035402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.035402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.035402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.035402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.035710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.157450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1055/2114] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:22.159367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.169589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0419607-a196-4c6d-b06b-db128146a8cf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.176022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.176705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.176986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.177261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.177995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.179612 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.191880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1060/2115] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:21 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:22.193652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.222367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1056/2116] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:22.223119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf9f3-4bf8-4744-8e14-c6702e0b9e5a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.223119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.223119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.223119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.223471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.223471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.223471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.223890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.235796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1061/2117] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:22.237356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41147484-157c-40e0-ae9b-e73b16e21ac4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.239733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.248529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.250961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1af0c-1301-4907-8a2c-2e723dc05728 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.252320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.252634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.254210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.254210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.255649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.257099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.258031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.258318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.258832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.259516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.261298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.274499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1057/2118] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:22.279797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.280002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1062/2119] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:22.287731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.293538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e83ce-3532-46dc-8ea8-3e1d07f4afb0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.302075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6e03-56c1-4397-a461-a9cd3ead7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.303038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6e03-56c1-4397-a461-a9cd3ead7e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.303327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6e03-56c1-4397-a461-a9cd3ead7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.303703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6e03-56c1-4397-a461-a9cd3ead7e95 admin admin] PATH_INFO: `/v3/projects/297721e633f54e5987d286ac16779da2/users/255431230d124a1b93fd2c090df0bf30/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.305371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8671-6ede-4c1c-aa47-0f5da7f27594 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.311062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7e4e-fa59-4489-8562-e37ffdb0a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.312291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7e4e-fa59-4489-8562-e37ffdb0a8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.312678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7e4e-fa59-4489-8562-e37ffdb0a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.313055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7e4e-fa59-4489-8562-e37ffdb0a8ae admin admin] PATH_INFO: `/v3/projects/0c96b1f3aaed4700a792cf9d25aaaca3/users/6f525569d9ed4d61926ddad83a270032/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.322994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a6e03-56c1-4397-a461-a9cd3ead7e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297721e633f54e5987d286ac16779da2, user_id=255431230d124a1b93fd2c090df0bf30, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.325878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a6e03-56c1-4397-a461-a9cd3ead7e95 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.329438 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c7e4e-fa59-4489-8562-e37ffdb0a8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c96b1f3aaed4700a792cf9d25aaaca3, user_id=6f525569d9ed4d61926ddad83a270032, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.332717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c7e4e-fa59-4489-8562-e37ffdb0a8ae admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.407168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1058/2120] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:22 2022] PUT /identity/v3/projects/297721e633f54e5987d286ac16779da2/users/255431230d124a1b93fd2c090df0bf30/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:22.421122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.423102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.423102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.448657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1063/2121] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:22 2022] PUT /identity/v3/projects/0c96b1f3aaed4700a792cf9d25aaaca3/users/6f525569d9ed4d61926ddad83a270032/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:22.453551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060e6e-5b30-4319-9f03-3905c18f99f9 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.453908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060e6e-5b30-4319-9f03-3905c18f99f9 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.454248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e060e6e-5b30-4319-9f03-3905c18f99f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.461285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] MFA Rules not processed for user `255431230d124a1b93fd2c090df0bf30`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:22.462398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:22.502213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7e060e6e-5b30-4319-9f03-3905c18f99f9 None None] MFA Rules not processed for user `5adf4837cc254e1a951dda183d795606`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:22.503593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7e060e6e-5b30-4319-9f03-3905c18f99f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:22.583489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1064/2122] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:22.587757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.587757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.587757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.588073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1059/2123] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:22.589211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.612857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:22.614292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:22.694665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3032f-79f6-41ae-8d60-4448dfaa81be None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.705351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.706448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.706842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.707231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.708118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:22.710448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:22.722251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1065/2124] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:22.726835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.731593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:22.833883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1060/2125] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:22 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:22.835095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:22.837325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:22.848485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0a0a-5dea-420c-9def-a73dd5fbb164 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.921841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754d7b5-d2b8-41cc-a923-957f72b952a1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:22.936060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.936978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.938291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.939396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:22.953279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:22.953279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:22.969343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:22.969343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.028877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.031559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.045953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1066/2126] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:23.049845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.059287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.060977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.072371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e14271-9cbe-4a38-817b-db1d5833c991 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:23.082323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:23.083133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:23.083412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:23.083751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.086726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.089294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1061/2127] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:23.089740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.236529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1067/2128] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:23 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:23.241698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.269732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723157-5d4e-4bb9-b6aa-85bc2aa85e1e service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:23.291676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:23.292893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:23.293374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:23.293884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.295336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.298812 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.328763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1062/2129] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:23.330912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.345191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c56d3f-8925-4ed6-8276-b1df03aa595d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:23.357508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:23.357508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:23.357508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:23.357508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] PATH_INFO: `/v3/projects/fd08f4eeff7b42b68e977cf0306c43e4/users/31c90bd0631b42899337a3a994e3189c/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.385753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd08f4eeff7b42b68e977cf0306c43e4, user_id=31c90bd0631b42899337a3a994e3189c, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.391261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.542448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.543235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1068/2130] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:23 2022] PUT /identity/v3/projects/fd08f4eeff7b42b68e977cf0306c43e4/users/31c90bd0631b42899337a3a994e3189c/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:23.557014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987fdad-cd4b-4d9f-93c0-305b3d49e4e0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:23.646302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01427c96-d028-4f59-95b7-80fa3c921ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:23.647010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01427c96-d028-4f59-95b7-80fa3c921ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:23.647292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01427c96-d028-4f59-95b7-80fa3c921ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:23.647566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01427c96-d028-4f59-95b7-80fa3c921ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.648343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01427c96-d028-4f59-95b7-80fa3c921ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.650056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01427c96-d028-4f59-95b7-80fa3c921ec5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.663380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1063/2131] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:23.667896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.679552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c18be-2706-495e-856d-2faceb83e479 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:23.684752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:23.685672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:23.685969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:23.686511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] PATH_INFO: `/v3/projects/fd08f4eeff7b42b68e977cf0306c43e4/users/31c90bd0631b42899337a3a994e3189c/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.688771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd08f4eeff7b42b68e977cf0306c43e4, user_id=31c90bd0631b42899337a3a994e3189c, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:23.692202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:23.715398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1069/2132] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:23 2022] PUT /identity/v3/projects/fd08f4eeff7b42b68e977cf0306c43e4/users/31c90bd0631b42899337a3a994e3189c/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:23.724244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:23.724557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:23.724815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:23.758746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] MFA Rules not processed for user `31c90bd0631b42899337a3a994e3189c`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:23.760706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:23.897163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1064/2133] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:23.909520 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.911040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:23.995877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:23.997419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:24.015168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317e0c1-763a-4c46-b726-9f2d6b587f24 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:24.015168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:24.015168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:24.015168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:24.016304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:24.032808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:24.037872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:24.055632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1070/2134] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:24.179756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81735d7-c047-4029-addb-fbc7f7f6a540 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:24.198688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:24.198688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:24.198920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:24.199209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] PATH_INFO: `/v3/users/ccdc151d95054a1ab00b8ef5d2c43094` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:24.201946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccdc151d95054a1ab00b8ef5d2c43094)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:24.203935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:24.282690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:24.295079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655404b-2835-4998-bb59-917edca53943 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:24.302736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:24.304619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:24.305162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:24.305526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] PATH_INFO: `/v3/users/255431230d124a1b93fd2c090df0bf30` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:24.307403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] RBAC: Authorizing `identity:delete_user(user_id=255431230d124a1b93fd2c090df0bf30)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:24.309670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:24.557066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccdc151d95054a1ab00b8ef5d2c43094'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.558007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccdc151d95054a1ab00b8ef5d2c43094'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.566241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccdc151d95054a1ab00b8ef5d2c43094'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.585165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccdc151d95054a1ab00b8ef5d2c43094'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.586852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-07b3f76c-73f7-4c47-b25f-9f7d5f5f0ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccdc151d95054a1ab00b8ef5d2c43094'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.595393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255431230d124a1b93fd2c090df0bf30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.608337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255431230d124a1b93fd2c090df0bf30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.625119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255431230d124a1b93fd2c090df0bf30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.626464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255431230d124a1b93fd2c090df0bf30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.628340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-67d32c54-1b1d-4ca5-ab70-7c77c68fdded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255431230d124a1b93fd2c090df0bf30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:24.734250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1065/2135] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:23 2022] DELETE /identity/v3/users/ccdc151d95054a1ab00b8ef5d2c43094 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:24.736000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:24.737166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:24.737542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:24.777542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:24.778771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:24.826165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1071/2136] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:24 2022] DELETE /identity/v3/users/255431230d124a1b93fd2c090df0bf30 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:24.832923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:24.833310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:24.833497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:24.865590 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1066/2137] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:24.882731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:24.885765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:24.889175 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:24.889396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:24.978556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac429b8f-5b16-40c1-9fac-cf35290dafdd None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:24.981943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1072/2138] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:24.993090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:25.078292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:25.079721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:25.080790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:25.081291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:25.096455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:25.101351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:25.111803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1067/2139] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:25.147377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a4b51-e285-4229-94a4-cffa4b2f9616 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:25.152384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:25.154530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:25.155388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:25.155892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:25.172220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:25.175443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:25.192455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1073/2140] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:26.110112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:26.110112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:26.113240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:26.116336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:26.144405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b41c-0c86-4967-ac8d-15183aff8ee5 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:26.146004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f11ff-e414-4454-8f8f-201de89bbb5b service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:26.160078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:26.162161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:26.163196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:26.163968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] PATH_INFO: `/v3/projects/b2f3b6497f064059bc4670f6ad91fa66` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:26.166538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f3b6497f064059bc4670f6ad91fa66)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:26.169061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:26.171531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:26.175741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:26.176848 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:26.177283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] PATH_INFO: `/v3/projects/297721e633f54e5987d286ac16779da2` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:26.178826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297721e633f54e5987d286ac16779da2)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:26.195115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:26.367971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f3b6497f064059bc4670f6ad91fa66', 'request_id': 'req-e1f42917-b94e-4765-8919-645a955df3fb'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.375988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f3b6497f064059bc4670f6ad91fa66', 'request_id': 'req-e1f42917-b94e-4765-8919-645a955df3fb'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.384195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f3b6497f064059bc4670f6ad91fa66', 'request_id': 'req-e1f42917-b94e-4765-8919-645a955df3fb'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.426724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297721e633f54e5987d286ac16779da2', 'request_id': 'req-80baca20-a469-46fe-8233-8f9507e88fb9'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.434437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297721e633f54e5987d286ac16779da2', 'request_id': 'req-80baca20-a469-46fe-8233-8f9507e88fb9'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.533249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] The token cache is being invalidate because project b2f3b6497f064059bc4670f6ad91fa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:26.534446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.536087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.539880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1068/2141] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:26 2022] DELETE /identity/v3/projects/b2f3b6497f064059bc4670f6ad91fa66 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:26.541603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:26.543187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:26.640691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f42917-b94e-4765-8919-645a955df3fb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:26.645591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297721e633f54e5987d286ac16779da2', 'request_id': 'req-80baca20-a469-46fe-8233-8f9507e88fb9'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.665311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] The token cache is being invalidate because project 297721e633f54e5987d286ac16779da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:26.669612 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.672916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:26.678184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1074/2142] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:26 2022] DELETE /identity/v3/projects/297721e633f54e5987d286ac16779da2 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:26.680266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:26.682151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:26.775956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:26.778336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:26.778830 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:26.779268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] PATH_INFO: `/v3/users/bf1f37a83f4d44f2be15d12fd50ba2ec` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:26.782866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1f37a83f4d44f2be15d12fd50ba2ec)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:26.785754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:26.858546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baca20-a469-46fe-8233-8f9507e88fb9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:26.879534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:26.881376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:26.885046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:26.885682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] PATH_INFO: `/v3/users/31c90bd0631b42899337a3a994e3189c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:26.890538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c90bd0631b42899337a3a994e3189c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:26.900861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:27.116874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1f37a83f4d44f2be15d12fd50ba2ec'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.118213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1f37a83f4d44f2be15d12fd50ba2ec'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.144414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c90bd0631b42899337a3a994e3189c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.153278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1f37a83f4d44f2be15d12fd50ba2ec'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.155602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c90bd0631b42899337a3a994e3189c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.176844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1f37a83f4d44f2be15d12fd50ba2ec'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.178057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-70568e5f-536b-425e-9b4d-595971baf207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1f37a83f4d44f2be15d12fd50ba2ec'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.180500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c90bd0631b42899337a3a994e3189c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.181878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c90bd0631b42899337a3a994e3189c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.182489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c90bd0631b42899337a3a994e3189c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.319181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1075/2143] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:26 2022] DELETE /identity/v3/users/31c90bd0631b42899337a3a994e3189c => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:27.320164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:27.321911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:27.474574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1069/2144] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:26 2022] DELETE /identity/v3/users/bf1f37a83f4d44f2be15d12fd50ba2ec => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:27.502002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b574-c2bd-4fc4-8511-e060e32d416d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:27.645103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:27.646160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:27.646517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:27.646866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] PATH_INFO: `/v3/users/96611673c58a46eeac9056c58ee1d98b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:27.648690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=96611673c58a46eeac9056c58ee1d98b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:27.652147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:27.979080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96611673c58a46eeac9056c58ee1d98b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:27.986469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96611673c58a46eeac9056c58ee1d98b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.015062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96611673c58a46eeac9056c58ee1d98b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.019607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96611673c58a46eeac9056c58ee1d98b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.020403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96611673c58a46eeac9056c58ee1d98b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.094773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1076/2145] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:27 2022] DELETE /identity/v3/users/96611673c58a46eeac9056c58ee1d98b => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:28.100369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:28.101036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:28.101468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:28.145510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:28.147997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:28.281417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1070/2146] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:28.292133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:28.295791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:28.366937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:28.368588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:28.376279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c4632-0a61-4418-ad11-361264aaa8fa admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:28.381042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:28.381849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:28.382194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:28.385067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968d6f-9cb1-4f3f-b00f-4c2bee6c040a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:28.389493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:28.389927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:28.391569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:28.391886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:28.392220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] PATH_INFO: `/v3/projects/3093c3ddb1fe4bff96d3cddd01903822` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:28.393486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3093c3ddb1fe4bff96d3cddd01903822)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:28.395803 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:28.425731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:28.427420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:28.476204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1077/2147] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:28.483984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:28.485875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:28.515893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28686fc-ab8e-493d-aa0f-6b6ef476cb5d service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:28.528737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:28.530265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:28.530625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:28.530974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] PATH_INFO: `/v3/projects/fd08f4eeff7b42b68e977cf0306c43e4` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:28.532330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd08f4eeff7b42b68e977cf0306c43e4)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:28.540092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:28.593119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3093c3ddb1fe4bff96d3cddd01903822', 'request_id': 'req-05582c9a-c137-4492-8f27-43657b795d79'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.611579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3093c3ddb1fe4bff96d3cddd01903822', 'request_id': 'req-05582c9a-c137-4492-8f27-43657b795d79'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.629648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3093c3ddb1fe4bff96d3cddd01903822', 'request_id': 'req-05582c9a-c137-4492-8f27-43657b795d79'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.734747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd08f4eeff7b42b68e977cf0306c43e4', 'request_id': 'req-1fee6ee0-d893-473c-81e7-e2cafe02c231'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.744545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] The token cache is being invalidate because project 3093c3ddb1fe4bff96d3cddd01903822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:28.744974 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.746545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.749040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1071/2148] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:28 2022] DELETE /identity/v3/projects/3093c3ddb1fe4bff96d3cddd01903822 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:28.753260 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:28.753479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd08f4eeff7b42b68e977cf0306c43e4', 'request_id': 'req-1fee6ee0-d893-473c-81e7-e2cafe02c231'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.760862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:28.846205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd08f4eeff7b42b68e977cf0306c43e4', 'request_id': 'req-1fee6ee0-d893-473c-81e7-e2cafe02c231'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.894558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] The token cache is being invalidate because project fd08f4eeff7b42b68e977cf0306c43e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:28.897359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.901691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1fee6ee0-d893-473c-81e7-e2cafe02c231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:28.904033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1078/2149] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:28 2022] DELETE /identity/v3/projects/fd08f4eeff7b42b68e977cf0306c43e4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:28.912981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf00a7-1285-495e-ba87-3076e7eead8b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:28.913473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf00a7-1285-495e-ba87-3076e7eead8b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:28.915315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf00a7-1285-495e-ba87-3076e7eead8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:28.972593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-03cf00a7-1285-495e-ba87-3076e7eead8b None None] MFA Rules not processed for user `5adf4837cc254e1a951dda183d795606`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:28.978459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-03cf00a7-1285-495e-ba87-3076e7eead8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:29.002485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582c9a-c137-4492-8f27-43657b795d79 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:29.149922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1079/2150] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:29.154829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820308-650d-41f3-8912-fbee6d9579fc None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.155493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820308-650d-41f3-8912-fbee6d9579fc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.156940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b820308-650d-41f3-8912-fbee6d9579fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.211255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:29.213370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.213665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.213953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] PATH_INFO: `/v3/users/440c5947cd4d47e19854efb37467c44f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.222410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440c5947cd4d47e19854efb37467c44f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:29.224981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:29.264906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2b820308-650d-41f3-8912-fbee6d9579fc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:29.264906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2b820308-650d-41f3-8912-fbee6d9579fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:29.274484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1080/2151] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:29.284455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.287454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.287454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.315722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:29.317343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:29.327279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1081/2152] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:29.332462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:29.343470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9d039-36b9-4413-ac98-4e96d03d6169 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:29.349381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:29.350194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.350537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.350875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.351989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:29.361867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:29.363633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:29.382259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1082/2153] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:10:29.386650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:29.405321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b2e66-4fb7-4286-b12f-84eb5c0049dd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:29.415583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:29.416314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.416596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.416870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.417566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:29.419450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:29.455083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440c5947cd4d47e19854efb37467c44f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.456955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440c5947cd4d47e19854efb37467c44f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.465002 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440c5947cd4d47e19854efb37467c44f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.488599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440c5947cd4d47e19854efb37467c44f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.489452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440c5947cd4d47e19854efb37467c44f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.520406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1083/2154] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:29 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:29.530267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:29.537389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:29.589669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1072/2155] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:28 2022] DELETE /identity/v3/users/440c5947cd4d47e19854efb37467c44f => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:29.651315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:29.653675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:29.662393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70977f1-7219-49be-b255-cfa86dae32db admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:29.761120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbe0b-188d-4e97-adde-f409b18ce493 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:29.766387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:29.767422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.768928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.769396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] PATH_INFO: `/v3/projects/39d607e124af4032839d8dee89c47a15` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.771046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d607e124af4032839d8dee89c47a15)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:29.773346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:29.807441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:29.808160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:29.808446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:29.808726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:29.809439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:29.811573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:29.913683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d607e124af4032839d8dee89c47a15', 'request_id': 'req-4a509d01-1e00-408f-a544-e3e531563c46'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.919578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1084/2156] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:29 2022] POST /identity/v3/users => generated 287 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:29.923593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:29.926692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d607e124af4032839d8dee89c47a15', 'request_id': 'req-4a509d01-1e00-408f-a544-e3e531563c46'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.933264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d607e124af4032839d8dee89c47a15', 'request_id': 'req-4a509d01-1e00-408f-a544-e3e531563c46'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:29.942356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b3329-e2de-40c3-9fd3-ccf6479be0c0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.024622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] The token cache is being invalidate because project 39d607e124af4032839d8dee89c47a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:30.025452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:30.027649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4a509d01-1e00-408f-a544-e3e531563c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:30.034523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1073/2157] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:29 2022] DELETE /identity/v3/projects/39d607e124af4032839d8dee89c47a15 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:30.037698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdec1b-1f9b-4b11-847c-1405008be492 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.038374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdec1b-1f9b-4b11-847c-1405008be492 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.038810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdec1b-1f9b-4b11-847c-1405008be492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.047003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.047713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.048028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.048325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.049632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.052591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.076046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8efdec1b-1f9b-4b11-847c-1405008be492 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:30.077622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8efdec1b-1f9b-4b11-847c-1405008be492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:30.086061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1085/2158] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:30.087317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.090416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1074/2159] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:30.099380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:30.100043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.100482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.100966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.113832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f26a8-9433-48ed-b37d-fde619b30523 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.125321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.126209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.126323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.126624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.128032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.137604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.166859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1086/2160] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:30.171194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.182370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:30.183652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:30.200247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923313d0-07fe-4ac8-b905-2d55c17bcb76 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.219439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1075/2161] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:30.221029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.230048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd06d7-fae9-4b1b-9769-85be45e39793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.230969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd06d7-fae9-4b1b-9769-85be45e39793 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.231754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd06d7-fae9-4b1b-9769-85be45e39793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.233485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53964f1d-f99b-48c1-b7b0-a6c73a234cf7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.239222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd06d7-fae9-4b1b-9769-85be45e39793 admin admin] PATH_INFO: `/v3/projects/3bd0155fa35040f9a2463ea82e565838/users/3bd917a04cd74573be781db4d4d72816/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.240090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.240757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.241088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.241373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.242160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:30.242476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.244273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.259029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1076/2162] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:30.263373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.274416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5ecf0-98bf-4a86-8707-eeb57e36de36 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.276977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd06d7-fae9-4b1b-9769-85be45e39793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd0155fa35040f9a2463ea82e565838, user_id=3bd917a04cd74573be781db4d4d72816, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.280121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.281791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.282075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.282353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.283365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.285898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.286648 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd06d7-fae9-4b1b-9769-85be45e39793 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.410583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1087/2163] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:30 2022] PUT /identity/v3/projects/3bd0155fa35040f9a2463ea82e565838/users/3bd917a04cd74573be781db4d4d72816/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:30.421575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.421877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.422212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.481811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] MFA Rules not processed for user `3bd917a04cd74573be781db4d4d72816`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:30.483238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:30.498183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1077/2164] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:30 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:30.502634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.640149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc542f2-1572-4771-946d-eba5778e9848 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.651767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1088/2165] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:30.653189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.657416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:30.662488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.663581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.664619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.665336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.666841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.673219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.789949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1078/2166] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:30 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:30.794023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:30.801847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:30.807540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a194e02-7cf8-449c-a0f9-9b4d033061bc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:30.816657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:30.817777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:30.818205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:30.818653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] PATH_INFO: `/v3/projects/a712697b469a4b83ba43f151642d9077` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:30.820106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a712697b469a4b83ba43f151642d9077)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:30.823147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:30.928989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2e5e-0c62-4a9a-9b24-6c5c790af1da admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:31.004277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a712697b469a4b83ba43f151642d9077', 'request_id': 'req-2d580852-26a0-42c1-9811-e1778053127c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.040465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a712697b469a4b83ba43f151642d9077', 'request_id': 'req-2d580852-26a0-42c1-9811-e1778053127c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.064026 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cf5ea-99b1-482d-a5b1-cb797d9e82e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:31.065804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf5ea-99b1-482d-a5b1-cb797d9e82e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.066322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf5ea-99b1-482d-a5b1-cb797d9e82e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.066805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cf5ea-99b1-482d-a5b1-cb797d9e82e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.136560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a712697b469a4b83ba43f151642d9077', 'request_id': 'req-2d580852-26a0-42c1-9811-e1778053127c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.166829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] The token cache is being invalidate because project a712697b469a4b83ba43f151642d9077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:31.168005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.170253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.182339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1089/2167] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:30 2022] DELETE /identity/v3/projects/a712697b469a4b83ba43f151642d9077 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:31.182339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:31.184419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:31.285182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cf5ea-99b1-482d-a5b1-cb797d9e82e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:31.288917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cf5ea-99b1-482d-a5b1-cb797d9e82e0 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:31.308363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1079/2168] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:31.312025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.315601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.316146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.397619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:31.401171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:31.450939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d580852-26a0-42c1-9811-e1778053127c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:31.468726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:31.469439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.469800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.470140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.471921 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:31.477258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:31.499160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1090/2169] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:31.500204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:31.504979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:31.537504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacadb0-647d-44d9-a1b7-efa3ac5ae7a5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:31.554298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:31.555310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.556023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.556814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] PATH_INFO: `/v3/users/3bd917a04cd74573be781db4d4d72816` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.559937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd917a04cd74573be781db4d4d72816)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:31.563864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:31.564676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1080/2170] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:31.582552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:31.584604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3971f-c58d-4e78-a5c5-02e69b975eb4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:31.589842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8acd-1f0d-43ec-969a-bd279cbc8086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:31.590633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8acd-1f0d-43ec-969a-bd279cbc8086 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.591058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8acd-1f0d-43ec-969a-bd279cbc8086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.591377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8acd-1f0d-43ec-969a-bd279cbc8086 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.592477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe8acd-1f0d-43ec-969a-bd279cbc8086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:31.594523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe8acd-1f0d-43ec-969a-bd279cbc8086 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:31.611966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1081/2171] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:31.613016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.615488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.616256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.651198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:31.654250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:31.673338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1082/2172] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:31.679317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:31.699225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708a0b4-0ce9-4284-bd9b-6f8e7da7e986 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:31.705938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:31.708118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.708118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.708675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] PATH_INFO: `/v3/projects/4a32c0f0c75a4b60b22643dcf109c6bc/users/1a145da296e44493a64515b7bc7ccaa4/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.739669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a32c0f0c75a4b60b22643dcf109c6bc, user_id=1a145da296e44493a64515b7bc7ccaa4, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:31.746889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:31.800457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd917a04cd74573be781db4d4d72816'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.810410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd917a04cd74573be781db4d4d72816'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.826658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd917a04cd74573be781db4d4d72816'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.827598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd917a04cd74573be781db4d4d72816'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.828267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-63ea15c8-7aa4-49b1-883c-ef92e5a25ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd917a04cd74573be781db4d4d72816'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:31.830887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1083/2173] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:31 2022] PUT /identity/v3/projects/4a32c0f0c75a4b60b22643dcf109c6bc/users/1a145da296e44493a64515b7bc7ccaa4/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:31.839946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:31.841061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:31.915114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1091/2174] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:31 2022] DELETE /identity/v3/users/3bd917a04cd74573be781db4d4d72816 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:31.917088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ec7c-d48e-4316-bcfc-d9fe5ce733ea None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:31.917584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ec7c-d48e-4316-bcfc-d9fe5ce733ea None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:31.917874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8ec7c-d48e-4316-bcfc-d9fe5ce733ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:31.981964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db60f5-4dae-4f64-8e5f-f048eae0550f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.006724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-37d8ec7c-d48e-4316-bcfc-d9fe5ce733ea None None] MFA Rules not processed for user `1a145da296e44493a64515b7bc7ccaa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:32.008261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-37d8ec7c-d48e-4316-bcfc-d9fe5ce733ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:32.111679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.112581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.112986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.113451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.121182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:32.125444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.128628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.134572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1092/2175] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:32.140829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.141352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.141784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.159365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1084/2176] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:32.165097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.175525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:32.184699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:32.192319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:32.218778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1093/2177] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:32.220006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.258498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04104f03-3da0-47b5-a107-33cf7c20f0f3 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.296617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.299611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.302993 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.303468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.304747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.307682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.375636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed85865-cc0a-4748-8a90-2cc8e41ca827 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.388767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.389001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.389417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.389793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.420390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.423246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.446102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1094/2178] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:32 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:32.447265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.451705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1085/2179] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:32.452694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.464634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:32.479440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0defce-ff43-4252-be42-fa03a55f8bed service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.641447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.643992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.645933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.646330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.646705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d2a9c-2999-41af-8efb-1bc3511268fc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.648872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.651998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.652916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.653839 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.654121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.655260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.673502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.674969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.697477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1095/2180] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:32.793933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1086/2181] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:32 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:32.795119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.813727 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14161d4d-ef30-455f-8ee6-b30d62e37d71 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.825701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.828577 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.829080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.830282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.831628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.833527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.856699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.871803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1096/2182] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:32.872051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087af14-e2e5-4390-b467-96a4be1cbc38 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.879406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896257f-b11e-45d7-a2d8-aca10c709ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.880601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896257f-b11e-45d7-a2d8-aca10c709ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.885493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896257f-b11e-45d7-a2d8-aca10c709ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.885493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896257f-b11e-45d7-a2d8-aca10c709ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.885493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896257f-b11e-45d7-a2d8-aca10c709ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.885493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896257f-b11e-45d7-a2d8-aca10c709ad6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:32.899134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1087/2183] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:32.903263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:32.918758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa66cb4-6a9c-4e98-a04a-b09befc511fa admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:32.925188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:32.926075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:32.926368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:32.926666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] PATH_INFO: `/v3/projects/11101d4d9e294098970ee3cabbfcdabd/users/958d1dbc2422461cbdc1e04eb0d9683a/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:32.948790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=11101d4d9e294098970ee3cabbfcdabd, user_id=958d1dbc2422461cbdc1e04eb0d9683a, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:32.949598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:33.052871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1097/2184] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:32 2022] PUT /identity/v3/projects/11101d4d9e294098970ee3cabbfcdabd/users/958d1dbc2422461cbdc1e04eb0d9683a/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:33.065006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:33.066432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:33.066959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:33.139912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] MFA Rules not processed for user `958d1dbc2422461cbdc1e04eb0d9683a`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:33.141601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:33.219339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1088/2185] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:33.363810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:33.365524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:33.467629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069559f-ef0e-4d08-90a6-03a86ea91cad admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:33.478421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:33.479152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:33.479444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:33.479770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:33.504225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:33.506060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:33.521859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1098/2186] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:33.546882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:33.610416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:33.612442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:33.685772 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b3370-3f0d-4990-9e23-c24a9ec1b7bc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:33.693752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:33.694780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:33.695163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:33.695537 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] PATH_INFO: `/v3/users/958d1dbc2422461cbdc1e04eb0d9683a` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:33.697038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958d1dbc2422461cbdc1e04eb0d9683a)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:33.702456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:33.793752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b20e8-23b1-40b5-9aae-23eec9e1d25d service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:33.802960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:33.804526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:33.805051 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:33.805703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] PATH_INFO: `/v3/projects/3bd0155fa35040f9a2463ea82e565838` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:33.807957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd0155fa35040f9a2463ea82e565838)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:33.810352 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:33.933347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958d1dbc2422461cbdc1e04eb0d9683a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:33.934511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958d1dbc2422461cbdc1e04eb0d9683a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:33.960732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958d1dbc2422461cbdc1e04eb0d9683a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:33.979899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd0155fa35040f9a2463ea82e565838', 'request_id': 'req-99db729e-dc3b-43bc-84c1-1ab4b5078b89'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:33.991851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd0155fa35040f9a2463ea82e565838', 'request_id': 'req-99db729e-dc3b-43bc-84c1-1ab4b5078b89'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:34.002584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958d1dbc2422461cbdc1e04eb0d9683a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:34.003707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0ca46213-a210-4791-8e18-59557a3f4709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958d1dbc2422461cbdc1e04eb0d9683a'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:34.086026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd0155fa35040f9a2463ea82e565838', 'request_id': 'req-99db729e-dc3b-43bc-84c1-1ab4b5078b89'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:34.101468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] The token cache is being invalidate because project 3bd0155fa35040f9a2463ea82e565838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:34.101741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:34.102663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-99db729e-dc3b-43bc-84c1-1ab4b5078b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:34.107656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1099/2187] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:33 2022] DELETE /identity/v3/projects/3bd0155fa35040f9a2463ea82e565838 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:34.109283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b01c3-a5d7-4ac5-9d68-11b16b11cba5 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.109572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b01c3-a5d7-4ac5-9d68-11b16b11cba5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.109855 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b01c3-a5d7-4ac5-9d68-11b16b11cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.139454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7f7b01c3-a5d7-4ac5-9d68-11b16b11cba5 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:34.140957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7f7b01c3-a5d7-4ac5-9d68-11b16b11cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:34.192759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1089/2188] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:33 2022] DELETE /identity/v3/users/958d1dbc2422461cbdc1e04eb0d9683a => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:34.199178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ac68-0d7e-4a58-8650-f6efb4d88b9e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.200003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ac68-0d7e-4a58-8650-f6efb4d88b9e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.200594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ac68-0d7e-4a58-8650-f6efb4d88b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.232182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8ab1ac68-0d7e-4a58-8650-f6efb4d88b9e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:34.235473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8ab1ac68-0d7e-4a58-8650-f6efb4d88b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:34.260279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1100/2189] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:34.264510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.264922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.265300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.358110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:34.359452 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:34.398849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1090/2190] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:34.400280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.400579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.401091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.452499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] MFA Rules not processed for user `6f525569d9ed4d61926ddad83a270032`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:34.453794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:34.467982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1101/2191] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:34.472227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:34.473818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:34.531516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1091/2192] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:34.532607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:34.551276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e573-6eaf-4a14-a241-dcec47d2c26a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:34.555680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:34.556391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.556817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.556998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.557393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207adb1-ec5f-4170-8636-eb11156a75ca None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:34.563105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:34.564068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.565042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.566545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.567557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:34.568459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:34.572877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:34.577262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:34.580154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:34.596212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1092/2193] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:34.596675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:34.598935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:34.617149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55944cf-d7f9-4f12-97df-9b8a519e48e5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:34.622150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1102/2194] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:34.623269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:34.638473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:34.639292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.639496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.639906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.643642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:34.643642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:34.648073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313039c-e2cc-4291-95f6-61a52e7d9d51 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:34.668161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:34.668919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:34.669210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:34.669669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:34.670391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:34.677238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:34.795449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1093/2195] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:34.808206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:34.841334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1103/2196] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:34.846017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:34.942859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4c83b-a302-4f52-a9de-4ccae20ea532 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.006062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbe6c-3a5e-4294-9e63-2d0c8a6b3437 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.022529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.023372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.023722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.024100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.024944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.030799 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.099130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.099778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.100274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.100563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.104836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.111683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.119156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1104/2197] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:35.122728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:35.141459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e343f-d42e-4a97-a81d-51143ea81516 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.153041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.154027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.154531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.154885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.155724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.157549 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.174265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1105/2198] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:35.175643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:35.177448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:35.201781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0fc0-00bf-4bb3-897e-024f22643bfa admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.211940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.213151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.213546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.213932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] PATH_INFO: `/v3/projects/11101d4d9e294098970ee3cabbfcdabd` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.215303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=11101d4d9e294098970ee3cabbfcdabd)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.217563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.277853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1094/2199] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:34 2022] POST /identity/v3/users => generated 296 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:35.278277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:35.302402 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c675-917f-4feb-a8bf-971e496907bc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.310663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.311504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.311796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.312116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.312864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.314873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.339716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1095/2200] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:35.340785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:35.377526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9b9bb-18fb-4a68-be43-a9e4f8d8ebfa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.388207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.390280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.390574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.390860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.392662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.394827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.429137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1096/2201] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:35.429137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:35.452771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bd061-1be6-455b-8e15-50c9f9057164 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.458750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11101d4d9e294098970ee3cabbfcdabd', 'request_id': 'req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:35.487927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11101d4d9e294098970ee3cabbfcdabd', 'request_id': 'req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:35.537870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4e52a-f35f-44ec-878a-35c0cc4cda0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.539269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e52a-f35f-44ec-878a-35c0cc4cda0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.539626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e52a-f35f-44ec-878a-35c0cc4cda0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.540129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4e52a-f35f-44ec-878a-35c0cc4cda0e admin admin] PATH_INFO: `/v3/projects/15063e26e50c43e3913dc29d8a4241dd/users/bdf4c5375d8746b68edad7faae5423a2/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.562050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4e52a-f35f-44ec-878a-35c0cc4cda0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15063e26e50c43e3913dc29d8a4241dd, user_id=bdf4c5375d8746b68edad7faae5423a2, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.565958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4e52a-f35f-44ec-878a-35c0cc4cda0e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.599323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11101d4d9e294098970ee3cabbfcdabd', 'request_id': 'req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:35.614063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] The token cache is being invalidate because project 11101d4d9e294098970ee3cabbfcdabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:35.614347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:35.615115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:35.620191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1106/2202] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:35 2022] DELETE /identity/v3/projects/11101d4d9e294098970ee3cabbfcdabd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:35.621021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:35.622362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:35.635512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb463e0-87ca-49c1-8d08-fa33dfea31ff admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:35.641642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbbcec-66de-4249-8200-9490752f6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:35.642941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbbcec-66de-4249-8200-9490752f6187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.643366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbbcec-66de-4249-8200-9490752f6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.643722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbbcec-66de-4249-8200-9490752f6187 admin admin] PATH_INFO: `/v3/projects/ae80b3a710c845deaebd80650162c77a/users/f9f87c6237d644b0b1c2232078a1dd91/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.660442 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbbcec-66de-4249-8200-9490752f6187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae80b3a710c845deaebd80650162c77a, user_id=f9f87c6237d644b0b1c2232078a1dd91, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:35.663212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbbcec-66de-4249-8200-9490752f6187 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:35.668138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1097/2203] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:35 2022] PUT /identity/v3/projects/15063e26e50c43e3913dc29d8a4241dd/users/bdf4c5375d8746b68edad7faae5423a2/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:35.668138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4051a-e78d-4f3e-962d-f381c7e8b1ec None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.668138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4051a-e78d-4f3e-962d-f381c7e8b1ec None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.668138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4051a-e78d-4f3e-962d-f381c7e8b1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.687464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-1cb4051a-e78d-4f3e-962d-f381c7e8b1ec None None] MFA Rules not processed for user `70516383f3b14d5283462803cac26d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:35.688806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1cb4051a-e78d-4f3e-962d-f381c7e8b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:35.754463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1107/2204] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:35 2022] PUT /identity/v3/projects/ae80b3a710c845deaebd80650162c77a/users/f9f87c6237d644b0b1c2232078a1dd91/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:35.754463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.754463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.754463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.799421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:35.800992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:35.805047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1098/2205] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:35.809117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130231-4244-4c3c-bffe-59bf1fcd063c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:35.809117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130231-4244-4c3c-bffe-59bf1fcd063c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:35.809117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130231-4244-4c3c-bffe-59bf1fcd063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:35.862532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-80130231-4244-4c3c-bffe-59bf1fcd063c None None] MFA Rules not processed for user `bdf4c5375d8746b68edad7faae5423a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:35.864458 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-80130231-4244-4c3c-bffe-59bf1fcd063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:35.980538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1108/2206] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:35.981449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.083972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1099/2207] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:36.083972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.083972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.083972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.084924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab752-f8f4-41ce-bec6-b02ffd825155 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.084924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.084924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.084924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.085277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.085277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.085277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.085277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1109/2208] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:36.085604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:36.085604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:36.085604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1100/2209] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:36.085856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.085949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.086041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d275a-7a9b-4499-b7d0-88fdb0c1df5c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.089164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a464c-9efe-49d6-b097-8e717f9f9064 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.095525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.096378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.096597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.097109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] PATH_INFO: `/v3/projects/ae80b3a710c845deaebd80650162c77a/users/f9f87c6237d644b0b1c2232078a1dd91/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.098946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae80b3a710c845deaebd80650162c77a, user_id=f9f87c6237d644b0b1c2232078a1dd91, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.101976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.102706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.104635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.105101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.105543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.106996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:36.107991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.110392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.116720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1110/2210] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:36 2022] PUT /identity/v3/projects/ae80b3a710c845deaebd80650162c77a/users/f9f87c6237d644b0b1c2232078a1dd91/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:36.117333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.119040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:36.151502 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1101/2211] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:36.156020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.214482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce7de0-048d-49af-b708-660b35edb414 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.214854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6f700-9a88-4571-abd1-422649a12a2a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.214854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.225644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.226546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.226979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.282486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.282486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.283396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.284628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.285354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.289242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.340591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.341962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.363760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1111/2212] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:36.427547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1102/2213] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:36 2022] POST /identity/v3/projects => generated 391 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:36.431187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.447632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8590653-c8d7-44bf-8b20-11d1c21f424a service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.582496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.583904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.584201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.584474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.585938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.589014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.709359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1112/2214] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:36 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:36.713302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.725770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c392-2f95-475c-9c8b-cde2a0422c10 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.744485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.758054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.758874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.759344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.760364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.766909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.820304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1103/2215] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:36.821180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.836055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e38047-3f9c-4775-91e8-2160713e7236 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.870917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bd217-5035-4f42-8e96-569981629f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.870917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd217-5035-4f42-8e96-569981629f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.870917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd217-5035-4f42-8e96-569981629f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.870917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd217-5035-4f42-8e96-569981629f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.871396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd217-5035-4f42-8e96-569981629f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:36.872408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd217-5035-4f42-8e96-569981629f2e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:36.914140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1113/2216] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:36.914821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:36.927264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7429c-8d8c-4f74-83d6-189944b286e4 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:36.951672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:36.951672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:36.951672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:36.951672 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] PATH_INFO: `/v3/projects/e6bede0a314248888f57950c990e12d8/users/45eafc8d98bd4da1af14022988a4dde4/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:36.992029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bede0a314248888f57950c990e12d8, user_id=45eafc8d98bd4da1af14022988a4dde4, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:37.006477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:37.123738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1104/2217] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:36 2022] PUT /identity/v3/projects/e6bede0a314248888f57950c990e12d8/users/45eafc8d98bd4da1af14022988a4dde4/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:37.134273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56e329-c9db-4fb8-8639-666641aa47c8 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:37.134690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56e329-c9db-4fb8-8639-666641aa47c8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:37.135211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56e329-c9db-4fb8-8639-666641aa47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:37.195355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ef56e329-c9db-4fb8-8639-666641aa47c8 None None] MFA Rules not processed for user `45eafc8d98bd4da1af14022988a4dde4`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:37.196981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ef56e329-c9db-4fb8-8639-666641aa47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:37.304040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1114/2218] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:37.318966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:37.415468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f49b2e-c01e-4021-bc98-c80703aa7f5b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:37.419766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:37.420677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:37.420966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:37.421253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:37.439869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:37.441699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:37.467369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1105/2219] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:44.956101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:44.958773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:44.959191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:44.995346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:44.997366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:45.015270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] MFA Rules not processed for user `f9f87c6237d644b0b1c2232078a1dd91`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:45.016764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:45.131678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323552-632a-4675-b0cf-f42900189601 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:45.145974 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:45.147101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:45.147560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:45.148482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] PATH_INFO: `/v3/users/bdf4c5375d8746b68edad7faae5423a2` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:45.150306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf4c5375d8746b68edad7faae5423a2)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:45.153196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:45.195819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1115/2220] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:45.214225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:45.216084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:45.412610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19db1-77d9-4314-b50c-b5c657d9ef22 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:45.424666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:45.425526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:45.425878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:45.426231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:45.428389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:45.438511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf4c5375d8746b68edad7faae5423a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:45.444504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf4c5375d8746b68edad7faae5423a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:45.462868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf4c5375d8746b68edad7faae5423a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:45.496696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf4c5375d8746b68edad7faae5423a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:45.505121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf4c5375d8746b68edad7faae5423a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:45.573761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:45.576542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacaa4b-88d4-40eb-a8d1-3ec5408fddd5 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:45.589010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1116/2221] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:45.624016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1106/2222] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:44 2022] DELETE /identity/v3/users/bdf4c5375d8746b68edad7faae5423a2 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:45.630768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:45.631378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:45.631721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:45.657181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:45.659317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:45.748273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1117/2223] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:45.755098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:45.761003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:45.872492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4875648-f06b-40f4-af4c-ee15f4333131 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:45.881357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d7d7a-c5bb-4b94-a1eb-5af60da6aea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:45.882585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d7d7a-c5bb-4b94-a1eb-5af60da6aea2 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:45.883053 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d7d7a-c5bb-4b94-a1eb-5af60da6aea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:45.883451 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d7d7a-c5bb-4b94-a1eb-5af60da6aea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:45.900312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d7d7a-c5bb-4b94-a1eb-5af60da6aea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:45.902245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d7d7a-c5bb-4b94-a1eb-5af60da6aea2 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:45.928437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1107/2224] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:46.647231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:46.648690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:46.664112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7978-b38b-4916-b26b-bf4c998fae3d None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:46.670150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:46.671104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:46.671458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:46.671808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] PATH_INFO: `/v3/projects/15063e26e50c43e3913dc29d8a4241dd` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:46.673172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=15063e26e50c43e3913dc29d8a4241dd)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:46.675500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:46.821075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15063e26e50c43e3913dc29d8a4241dd', 'request_id': 'req-1406ce1f-0630-4bae-adaa-08c360eaa16a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:46.827792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15063e26e50c43e3913dc29d8a4241dd', 'request_id': 'req-1406ce1f-0630-4bae-adaa-08c360eaa16a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:46.913643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15063e26e50c43e3913dc29d8a4241dd', 'request_id': 'req-1406ce1f-0630-4bae-adaa-08c360eaa16a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:46.932375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] The token cache is being invalidate because project 15063e26e50c43e3913dc29d8a4241dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:46.932711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:46.933381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1406ce1f-0630-4bae-adaa-08c360eaa16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:46.935401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1118/2225] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:46 2022] DELETE /identity/v3/projects/15063e26e50c43e3913dc29d8a4241dd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:46.940578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:46.941132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:46.941132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:46.962038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:46.963559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:47.071353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1108/2226] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:47.082129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.082423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.082699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.109237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:47.111565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:47.124356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1119/2227] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:47.125372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:47.140040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadf43a-6a96-4ce1-9f40-afe0f82caccb None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:47.151574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:47.152325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.152615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.157326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.157326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:47.157326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:47.157326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:47.185686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1109/2228] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:10:47.187671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:47.200069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f22b5-d387-4f0d-a631-205050f145bc None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:47.207513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:47.208764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.209217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.210572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.211446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:47.214392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:47.309705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1120/2229] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:47 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:47.310953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:47.322807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfddce-3aa0-4358-9166-bd74c01dd31f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:47.415724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:47.416429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.416689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.416967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.417682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:47.420281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:47.537971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1110/2230] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:47 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:47.542050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:47.554201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f770e1a-fd93-4467-a7a4-a16e40444933 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:47.558868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:47.559550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.559894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.560150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.560894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:47.562503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:47.574458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1121/2231] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:47.578699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:47.590341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6fd5c-8bc6-404f-bffa-3e6000d59cfa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:47.595088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad84da5-6285-43ea-9c36-958f9fc5cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:47.596336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad84da5-6285-43ea-9c36-958f9fc5cf25 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.596618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad84da5-6285-43ea-9c36-958f9fc5cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.596892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad84da5-6285-43ea-9c36-958f9fc5cf25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.597637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad84da5-6285-43ea-9c36-958f9fc5cf25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:47.599221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad84da5-6285-43ea-9c36-958f9fc5cf25 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:47.625101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1111/2232] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:47.626991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:47.640100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a101d6-2328-444a-b1d8-63570c685416 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:47.646974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:47.648285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.649301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.649742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] PATH_INFO: `/v3/projects/550923d1a09d4b1380c4a061e11456b8/users/36978503d74a42d28e90ebc51ede4fe5/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.669854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550923d1a09d4b1380c4a061e11456b8, user_id=36978503d74a42d28e90ebc51ede4fe5, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:47.674138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:47.750924 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1122/2233] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:47 2022] PUT /identity/v3/projects/550923d1a09d4b1380c4a061e11456b8/users/36978503d74a42d28e90ebc51ede4fe5/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:47.767151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:47.767759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:47.768387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:47.811479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] MFA Rules not processed for user `36978503d74a42d28e90ebc51ede4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:47.813029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:47.927744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1112/2234] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:47.932714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:48.000786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277eeeae-2aed-4021-9883-1efc83b6a8c7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:48.006301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:48.007135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.007234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.007585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.008290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:48.010287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:48.099789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1123/2235] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:47 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:48.104549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:48.118881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba753a1-72f8-4da0-9a66-06289e0b7bc4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:48.194170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:48.195303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.195414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.195896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.196678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:48.198707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:48.297794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1113/2236] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:48 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:48.302498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:48.314525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1824-b22a-46c7-bd4d-d6ead992e437 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:48.319522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:48.320241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.320691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.321123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.322078 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:48.324101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:48.340630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1124/2237] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:48.345901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:48.362930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76054489-f9b3-4e5a-915c-ba9e2c2d3cef admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:48.401664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716044ff-a490-4dcb-af97-e5cd859949ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:48.402582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716044ff-a490-4dcb-af97-e5cd859949ca admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.403618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716044ff-a490-4dcb-af97-e5cd859949ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.404565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716044ff-a490-4dcb-af97-e5cd859949ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.406219 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716044ff-a490-4dcb-af97-e5cd859949ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:48.420930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716044ff-a490-4dcb-af97-e5cd859949ca admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:48.438463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1114/2238] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:48.439824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:48.466222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf9a5-216b-43be-801c-2d26ded2371a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:48.479473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:48.480717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.481148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.481432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] PATH_INFO: `/v3/projects/c97e50105ef94665a7aa3d94adf7c6a7/users/c58cf539eeab4c3aa39bac93474536a6/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.527528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c97e50105ef94665a7aa3d94adf7c6a7, user_id=c58cf539eeab4c3aa39bac93474536a6, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:48.530486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:48.626314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1125/2239] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:48 2022] PUT /identity/v3/projects/c97e50105ef94665a7aa3d94adf7c6a7/users/c58cf539eeab4c3aa39bac93474536a6/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:48.635711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.637823 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.639115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.687653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] MFA Rules not processed for user `c58cf539eeab4c3aa39bac93474536a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:48.689341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:48.803409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1115/2240] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:48.809987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:48.890588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127e969-de2e-4b59-a15d-9f6f3f05ac80 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:48.897988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:48.898992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:48.899454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:48.899981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:48.900901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:48.911354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.088241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1126/2241] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:48 2022] POST /identity/v3/projects => generated 385 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:10:49.089901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:49.106758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fefc9-5577-4574-a7b2-95545ee89657 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:49.265321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:49.278522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.278818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.279286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.282158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:49.286055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.453688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1116/2242] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:49 2022] POST /identity/v3/users => generated 299 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:49.457916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:49.471360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddbd32-79eb-4d19-9f26-de5daf2b9238 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:49.485025 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:49.485751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.486080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.486415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.487292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:49.493876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.515322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1127/2243] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:49.521518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:49.541433 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ed65-c664-46e7-aacc-97b7dc8c2cfa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:49.553225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:49.554719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.555100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.555518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] PATH_INFO: `/v3/projects/529d81f1eb5347b5ab84f9950ea7fd59/users/ab58e2f63394471bb42034b98b343e34/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.578461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=529d81f1eb5347b5ab84f9950ea7fd59, user_id=ab58e2f63394471bb42034b98b343e34, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:49.581913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.634552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:49.638343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:49.676678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4c1e6-b5ee-4cf9-8f29-c59d4ee42131 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:49.677151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1117/2244] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:49 2022] PUT /identity/v3/projects/529d81f1eb5347b5ab84f9950ea7fd59/users/ab58e2f63394471bb42034b98b343e34/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:49.683863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:49.822371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc91bc-507c-4df9-a405-44f7388d7b4c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:49.830149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:49.830149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.830149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.830149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.830610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:49.831100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:49.832295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.832844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.833289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.833953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] PATH_INFO: `/v3/users/1a145da296e44493a64515b7bc7ccaa4` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.836079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a145da296e44493a64515b7bc7ccaa4)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:49.838376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.848151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1118/2245] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:49.860414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:49.886025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa829db-5d20-48f3-abb0-53ad24f6ce5e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:49.896156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ad21e-0e10-4cc3-8a5c-dff786221966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:49.897086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad21e-0e10-4cc3-8a5c-dff786221966 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.897519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad21e-0e10-4cc3-8a5c-dff786221966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.897798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad21e-0e10-4cc3-8a5c-dff786221966 admin admin] PATH_INFO: `/v3/projects/529d81f1eb5347b5ab84f9950ea7fd59/users/ab58e2f63394471bb42034b98b343e34/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.899966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ad21e-0e10-4cc3-8a5c-dff786221966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=529d81f1eb5347b5ab84f9950ea7fd59, user_id=ab58e2f63394471bb42034b98b343e34, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:49.902769 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ad21e-0e10-4cc3-8a5c-dff786221966 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:49.914432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1119/2246] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:49 2022] PUT /identity/v3/projects/529d81f1eb5347b5ab84f9950ea7fd59/users/ab58e2f63394471bb42034b98b343e34/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:49.924959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:49.925253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:49.925532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:49.956425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] MFA Rules not processed for user `ab58e2f63394471bb42034b98b343e34`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:49.957706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:50.036320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1120/2247] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:50.046303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:50.047664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:50.102232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a145da296e44493a64515b7bc7ccaa4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:50.107095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81598c-9691-482b-9d97-6a5fdaf8cde8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:50.109388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a145da296e44493a64515b7bc7ccaa4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:50.111055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed0b6e-09c8-44dc-ab9a-1bf2bd590bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:50.111983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed0b6e-09c8-44dc-ab9a-1bf2bd590bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:50.112418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed0b6e-09c8-44dc-ab9a-1bf2bd590bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:50.112702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed0b6e-09c8-44dc-ab9a-1bf2bd590bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:50.123125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a145da296e44493a64515b7bc7ccaa4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:50.123994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a145da296e44493a64515b7bc7ccaa4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:50.124707 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a145da296e44493a64515b7bc7ccaa4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:50.172204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed0b6e-09c8-44dc-ab9a-1bf2bd590bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:50.174369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed0b6e-09c8-44dc-ab9a-1bf2bd590bb3 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:50.183994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1121/2248] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:50.212174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1128/2249] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:10:49 2022] DELETE /identity/v3/users/1a145da296e44493a64515b7bc7ccaa4 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:50.217176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:50.217496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:50.217781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:50.237923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:50.239310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:50.315094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1122/2250] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:50.320486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:50.322413 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:50.412554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db5b84-fc23-4b2d-b797-d0661ff31198 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:50.416450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041000b-699b-471c-a0c7-2046ce0361cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:50.417196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041000b-699b-471c-a0c7-2046ce0361cb service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:50.417380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041000b-699b-471c-a0c7-2046ce0361cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:50.417658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041000b-699b-471c-a0c7-2046ce0361cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:50.432839 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041000b-699b-471c-a0c7-2046ce0361cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:50.443737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041000b-699b-471c-a0c7-2046ce0361cb service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:50.446658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1129/2251] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:50.948929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:50.950525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:50.975269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fad04-250e-403f-925c-7a7d055bac29 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:50.980130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:50.980994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:50.981275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:50.981578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] PATH_INFO: `/v3/projects/4a32c0f0c75a4b60b22643dcf109c6bc` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:50.982771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a32c0f0c75a4b60b22643dcf109c6bc)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:50.984723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:51.133291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a32c0f0c75a4b60b22643dcf109c6bc', 'request_id': 'req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:51.139889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a32c0f0c75a4b60b22643dcf109c6bc', 'request_id': 'req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:51.146856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a32c0f0c75a4b60b22643dcf109c6bc', 'request_id': 'req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:51.239539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] The token cache is being invalidate because project 4a32c0f0c75a4b60b22643dcf109c6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:10:51.239935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:51.240584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-1b7fb6ff-493c-445b-921f-3e08ea6c02ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:10:51.242254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1123/2252] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:10:50 2022] DELETE /identity/v3/projects/4a32c0f0c75a4b60b22643dcf109c6bc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:10:51.247317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.247873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.248033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.270864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:51.272669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:51.341617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1130/2253] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:10:51.359345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.359635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.360178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.382311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:51.383524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:51.392145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1124/2254] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:51.396718 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:51.407016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eae7be-fba3-4870-a7e3-ac640bdd40a6 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:51.412881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:51.413879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.414499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.415893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.416780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:10:51.420526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:51.420526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:51.438215 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1131/2255] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:10:51.445217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:51.460766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52f6d-450d-4693-9084-f3180ef92b64 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:51.463127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:51.463795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.464111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.464385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.465082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:51.467450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:51.623323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1125/2256] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:10:51 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:51.623803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:51.634930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db763ad6-baa7-4d49-a467-3cf5e4fa57c8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:51.694301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:51.695489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.695489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.695697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.696320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:51.698243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:51.800444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1132/2257] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:10:51 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:10:51.804516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:51.816890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb04e9-636c-49ce-a926-7a411b47c6cd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:51.822000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:51.822804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.823097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.823378 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.824205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:51.825842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:51.837874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1126/2258] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:10:51.842040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:51.853077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bdadc-ca3e-40b0-ae89-f83236dd308d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:51.857838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cca4c9-70d5-479e-8a84-d3a09a613519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:51.858510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca4c9-70d5-479e-8a84-d3a09a613519 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.858801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca4c9-70d5-479e-8a84-d3a09a613519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.859086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cca4c9-70d5-479e-8a84-d3a09a613519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.859823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cca4c9-70d5-479e-8a84-d3a09a613519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:51.861890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cca4c9-70d5-479e-8a84-d3a09a613519 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:51.872450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1133/2259] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:10:51.876792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:51.887442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b7fe8-5256-47c9-b385-98bd968432e3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:51.893434 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:51.894395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:51.894763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:51.895110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] PATH_INFO: `/v3/projects/5a3a8be1d18e47c68cb76760339bd305/users/6369e52f31104238b2323b84e0ad7fe6/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:51.914756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3a8be1d18e47c68cb76760339bd305, user_id=6369e52f31104238b2323b84e0ad7fe6, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:51.920370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:52.057140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1127/2260] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:10:51 2022] PUT /identity/v3/projects/5a3a8be1d18e47c68cb76760339bd305/users/6369e52f31104238b2323b84e0ad7fe6/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:10:52.068829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:52.069122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:52.069401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:52.097659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] MFA Rules not processed for user `6369e52f31104238b2323b84e0ad7fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:10:52.098874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:52.163424 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1134/2261] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:10:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:10:52.174061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:52.176226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:52.235201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f9d13-e23a-4be0-8257-7648b5ba0c43 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:52.240277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:52.240921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:52.241211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:52.241490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:52.250421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:52.251942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:52.261526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1128/2262] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:10:55.993321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:56.011814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:56.012890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9b8f7-5faf-4c51-a624-596bd94a67e5 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:56.017953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:56.018953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:56.019234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:56.019515 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:56.021485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:56.091187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:56.092801 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:56.111059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1135/2263] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:10:58.828328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:10:58.838239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382ad6c-f7e4-4e6f-bbc8-e82a57189c71 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:10:58.842267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:10:58.843007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:10:58.843297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:10:58.843577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:10:58.845625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:10:58.916334 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:10:58.917940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67725c-3ba0-4d6c-a257-08bb611e2f43 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:10:58.929987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1129/2264] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:07.275285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:07.276750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:07.494594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e46e6-18c1-4335-ad9c-c1a481cabec2 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:07.499436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:07.500327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:07.500616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:07.501027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] PATH_INFO: `/v3/users/45eafc8d98bd4da1af14022988a4dde4` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:07.502849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eafc8d98bd4da1af14022988a4dde4)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:07.505007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:07.729639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eafc8d98bd4da1af14022988a4dde4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:07.737092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eafc8d98bd4da1af14022988a4dde4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:07.748756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eafc8d98bd4da1af14022988a4dde4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:07.749509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eafc8d98bd4da1af14022988a4dde4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:07.755096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eafc8d98bd4da1af14022988a4dde4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:07.846375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1136/2265] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:07 2022] DELETE /identity/v3/users/45eafc8d98bd4da1af14022988a4dde4 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:07.853387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:07.853950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:07.853950 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:07.882955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:07.886427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:07.956101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1130/2266] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:07.966428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:07.968128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:08.083454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e16569-5b7d-4dd3-bc4f-75c44e7773c8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:08.087276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:08.087991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:08.088310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:08.088560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:08.099725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:08.101248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:08.111912 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1137/2267] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:08.635007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:08.637088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:08.672297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9776fd-c8dd-4cea-9375-161e407ea0cc None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:08.694235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:08.695151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:08.695438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:08.695712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] PATH_INFO: `/v3/projects/e6bede0a314248888f57950c990e12d8` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:08.697261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bede0a314248888f57950c990e12d8)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:08.702027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:08.891500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bede0a314248888f57950c990e12d8', 'request_id': 'req-5fd43689-5c73-4c2c-a8ef-0c982986fb98'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:08.904777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bede0a314248888f57950c990e12d8', 'request_id': 'req-5fd43689-5c73-4c2c-a8ef-0c982986fb98'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:08.915516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bede0a314248888f57950c990e12d8', 'request_id': 'req-5fd43689-5c73-4c2c-a8ef-0c982986fb98'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.028683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] The token cache is being invalidate because project e6bede0a314248888f57950c990e12d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:09.028683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.028683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fd43689-5c73-4c2c-a8ef-0c982986fb98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.031042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1131/2268] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:08 2022] DELETE /identity/v3/projects/e6bede0a314248888f57950c990e12d8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:09.184099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:09.186288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:09.201890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e3cc-6e5e-4696-a179-afc48f282ead service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:09.288045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:09.289464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:09.289929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:09.290401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] PATH_INFO: `/v3/users/36978503d74a42d28e90ebc51ede4fe5` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:09.292660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36978503d74a42d28e90ebc51ede4fe5)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:09.296328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:09.685883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36978503d74a42d28e90ebc51ede4fe5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.698590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36978503d74a42d28e90ebc51ede4fe5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.717770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36978503d74a42d28e90ebc51ede4fe5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.719061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36978503d74a42d28e90ebc51ede4fe5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.719681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36978503d74a42d28e90ebc51ede4fe5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:09.863465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1138/2269] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:09 2022] DELETE /identity/v3/users/36978503d74a42d28e90ebc51ede4fe5 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:09.870327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:09.870807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:09.871289 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:09.906246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:09.909809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:09.980001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1132/2270] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:09.990466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:09.991854 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:10.055867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497dd50-e384-41bb-9c63-13a1bc1bc93d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:10.059441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:10.060108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:10.060393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:10.060668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:10.071094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:10.072650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:10.083529 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1139/2271] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:10.192237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:10.193734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:10.205715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9675e-62ff-4106-9bf9-9210980813ad None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:10.210321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:10.211169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:10.211449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:10.211724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] PATH_INFO: `/v3/users/62e32b95f418402e9aa6ab9849421836` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:10.212961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e32b95f418402e9aa6ab9849421836)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:10.214865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:10.420896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e32b95f418402e9aa6ab9849421836'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.421562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e32b95f418402e9aa6ab9849421836'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.429600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e32b95f418402e9aa6ab9849421836'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.442345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e32b95f418402e9aa6ab9849421836'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.446534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f8f59622-87e8-4495-8a31-5de668c32f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e32b95f418402e9aa6ab9849421836'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.498502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:10.500064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:10.514448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1133/2272] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:10 2022] DELETE /identity/v3/users/62e32b95f418402e9aa6ab9849421836 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:10.524049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:10.524671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:10.525232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:10.526638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c69f3-d90e-41c7-ac98-90ad4c04a0b2 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:10.545247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:10.546646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:10.586743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:10.587504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:10.587786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:10.588092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] PATH_INFO: `/v3/projects/550923d1a09d4b1380c4a061e11456b8` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:10.589291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550923d1a09d4b1380c4a061e11456b8)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:10.591166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:10.607963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1134/2273] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:10.619161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:10.620756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:10.689647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f6568-1f70-4b00-9049-2e8ca3721c7f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:10.693441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:10.694087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:10.694376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:10.694651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:10.705159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:10.706640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:10.717505 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1135/2274] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:11:10.729028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550923d1a09d4b1380c4a061e11456b8', 'request_id': 'req-43a0cbf9-7295-4023-bec8-e65ec33b71e0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.734619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550923d1a09d4b1380c4a061e11456b8', 'request_id': 'req-43a0cbf9-7295-4023-bec8-e65ec33b71e0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.805174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550923d1a09d4b1380c4a061e11456b8', 'request_id': 'req-43a0cbf9-7295-4023-bec8-e65ec33b71e0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.818033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] The token cache is being invalidate because project 550923d1a09d4b1380c4a061e11456b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:10.818325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.818992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:10.820570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1140/2275] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:10 2022] DELETE /identity/v3/projects/550923d1a09d4b1380c4a061e11456b8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:10.824632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:10.826120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:10.841489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9dc20-0779-4b0b-b5c7-23a6affb662e service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:10.911894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:10.913520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:10.913992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:10.914424 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] PATH_INFO: `/v3/users/c58cf539eeab4c3aa39bac93474536a6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:10.916153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58cf539eeab4c3aa39bac93474536a6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:10.918992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:11.154099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58cf539eeab4c3aa39bac93474536a6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.156379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58cf539eeab4c3aa39bac93474536a6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.169388 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58cf539eeab4c3aa39bac93474536a6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.186350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58cf539eeab4c3aa39bac93474536a6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.187763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f284ad62-e5f3-4cfc-88b5-878a956a4c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58cf539eeab4c3aa39bac93474536a6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.291220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1136/2276] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:10 2022] DELETE /identity/v3/users/c58cf539eeab4c3aa39bac93474536a6 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:11.333781 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:11.335754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:11.349945 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0cbf9-7295-4023-bec8-e65ec33b71e0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:11.421957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:11.422941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:11.423350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:11.424018 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] PATH_INFO: `/v3/projects/4302f076c1c44015b2607dccd5813359` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:11.425589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4302f076c1c44015b2607dccd5813359)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:11.427728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:11.604927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4302f076c1c44015b2607dccd5813359', 'request_id': 'req-29f7d380-2c4e-401a-bad5-e501dbc8adb2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.612301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4302f076c1c44015b2607dccd5813359', 'request_id': 'req-29f7d380-2c4e-401a-bad5-e501dbc8adb2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.719794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4302f076c1c44015b2607dccd5813359', 'request_id': 'req-29f7d380-2c4e-401a-bad5-e501dbc8adb2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.731985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] The token cache is being invalidate because project 4302f076c1c44015b2607dccd5813359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:11.732281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.732931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:11.734482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1141/2277] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:11 2022] DELETE /identity/v3/projects/4302f076c1c44015b2607dccd5813359 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:11.740266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25128-fb2b-4a67-b874-20bc9c011f9d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:11.740565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25128-fb2b-4a67-b874-20bc9c011f9d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:11.740853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e25128-fb2b-4a67-b874-20bc9c011f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:11.779399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-70e25128-fb2b-4a67-b874-20bc9c011f9d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:11.780695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-70e25128-fb2b-4a67-b874-20bc9c011f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:11.830641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:11.832291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:11.854366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1137/2278] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:11.863304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:11.863600 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:11.863900 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:11.882809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:11.884064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:11.893728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1138/2279] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:11.898125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:11.908844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8b618-4336-49e1-ba25-b541b20b505d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:11.910415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7d380-2c4e-401a-bad5-e501dbc8adb2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:11.913713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:11.914368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:11.914648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:11.914928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:11.915628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:11.915754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:11:11.915990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:11.916687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:11.917048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:11.917398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] PATH_INFO: `/v3/projects/c97e50105ef94665a7aa3d94adf7c6a7` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:11.917675 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:11.918742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c97e50105ef94665a7aa3d94adf7c6a7)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:11.920808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:11.930098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1139/2280] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:11:11.934481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:11.944400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2ea42-92e7-439e-83ea-ed4f94cc5870 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:11.949452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:11.950217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:11.950534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:11.950791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:11.951481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:11.953665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.062883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c97e50105ef94665a7aa3d94adf7c6a7', 'request_id': 'req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.063401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1140/2281] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:11:12.067949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:12.069917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c97e50105ef94665a7aa3d94adf7c6a7', 'request_id': 'req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.125239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c97e50105ef94665a7aa3d94adf7c6a7', 'request_id': 'req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.130869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e95833-8477-4a0c-81c3-f3c31ada6856 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:12.135985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:12.136655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.137022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.137323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.138024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:12.139004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] The token cache is being invalidate because project c97e50105ef94665a7aa3d94adf7c6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:12.139405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.140019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.140299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.143139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1142/2282] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:11 2022] DELETE /identity/v3/projects/c97e50105ef94665a7aa3d94adf7c6a7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:12.146826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:12.148394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:12.217784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1141/2283] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:11:12 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:11:12.223375 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa39bb-25f6-47ad-95ee-a8ee793f2391 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:12.224144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:12.226383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:12.230308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:12.231367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.231679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.232023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] PATH_INFO: `/v3/users/ab58e2f63394471bb42034b98b343e34` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.233502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab58e2f63394471bb42034b98b343e34)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:12.236277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.248934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9643eb1-6a98-46fc-a933-9c305a3d67ee admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:12.255438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:12.256257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.256549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.256829 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.257820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:12.259528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.279902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1142/2284] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:12.284296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:12.294454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843bac-adb7-4b27-9739-eb42a317592c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:12.301802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:12.302985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.303494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.304060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.305477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:12.308623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.334409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1143/2285] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:11:12.335789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:12.346324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf23e44-03c4-4d1d-aee7-56daf7529605 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:12.351078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53a708-1217-4cb1-be19-274945c04cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:12.352004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53a708-1217-4cb1-be19-274945c04cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.352310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53a708-1217-4cb1-be19-274945c04cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.352607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53a708-1217-4cb1-be19-274945c04cf4 admin admin] PATH_INFO: `/v3/projects/f92cb7cf852c4790bb51e02de8b46c41/users/eef05bfef54c43ca8d0099ee98986766/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.367714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53a708-1217-4cb1-be19-274945c04cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92cb7cf852c4790bb51e02de8b46c41, user_id=eef05bfef54c43ca8d0099ee98986766, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:12.370588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53a708-1217-4cb1-be19-274945c04cf4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.449056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab58e2f63394471bb42034b98b343e34'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.456657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab58e2f63394471bb42034b98b343e34'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.468475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab58e2f63394471bb42034b98b343e34'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.469186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab58e2f63394471bb42034b98b343e34'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.469809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab58e2f63394471bb42034b98b343e34'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:12.476259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1144/2286] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:12 2022] PUT /identity/v3/projects/f92cb7cf852c4790bb51e02de8b46c41/users/eef05bfef54c43ca8d0099ee98986766/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:12.481054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.481249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.484383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.499781 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:12.501032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:12.538337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1143/2287] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:12 2022] DELETE /identity/v3/users/ab58e2f63394471bb42034b98b343e34 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:12.574198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1145/2288] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:12.584447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:12.585859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:12.649228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea09746-912b-415a-98a6-9683e31888bf admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:12.653073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc2e96-b444-4702-a841-3d377a961449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:12.653757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2e96-b444-4702-a841-3d377a961449 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:12.654044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2e96-b444-4702-a841-3d377a961449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:12.654322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2e96-b444-4702-a841-3d377a961449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:12.716197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc2e96-b444-4702-a841-3d377a961449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:12.717845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc2e96-b444-4702-a841-3d377a961449 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:12.729378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1144/2289] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:13.026789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.028764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:13.050774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85fa15-54d5-40d8-a712-86db72ca9124 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.061613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.062620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.063012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.063400 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] PATH_INFO: `/v3/projects/529d81f1eb5347b5ab84f9950ea7fd59` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.067397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=529d81f1eb5347b5ab84f9950ea7fd59)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.069865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:13.188228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '529d81f1eb5347b5ab84f9950ea7fd59', 'request_id': 'req-946bbea5-f84f-4e52-bfed-87fa201812ba'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:13.194958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '529d81f1eb5347b5ab84f9950ea7fd59', 'request_id': 'req-946bbea5-f84f-4e52-bfed-87fa201812ba'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:13.201809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '529d81f1eb5347b5ab84f9950ea7fd59', 'request_id': 'req-946bbea5-f84f-4e52-bfed-87fa201812ba'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:13.287547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] The token cache is being invalidate because project 529d81f1eb5347b5ab84f9950ea7fd59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:13.287880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:13.288558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-946bbea5-f84f-4e52-bfed-87fa201812ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:13.290191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1146/2290] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:13 2022] DELETE /identity/v3/projects/529d81f1eb5347b5ab84f9950ea7fd59 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:13.295319 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.295619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.295976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.314736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:13.315973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:13.379393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1145/2291] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:13.388715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.389006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.389220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.421722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:13.424765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:13.444364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1147/2292] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:13.448219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.464328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e72c-8e44-4f99-94b7-6d6a3eb09282 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.470872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.471688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.472021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.472303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.473120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:11:13.473432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.475079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:13.491471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1146/2293] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:11:13.496340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.506438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26e78e-6971-416a-95de-33b4a2aecab6 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.511698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.512766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.513056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.513570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.514375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.516713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:13.619542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1148/2294] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:11:13 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:13.623809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.635907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd61be7-a9ae-4d06-8f5a-c79eb7b45cfd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.702747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.703758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.704210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.705040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.705953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.708326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:13.772267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1147/2295] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:11:13 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:11:13.776570 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.789626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469bf5-54b1-48cd-83c5-a0dc264c7d25 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.793159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.794183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.794657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.794991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.795816 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.797497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:13.809483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1149/2296] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:13.813523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.831821 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66188e-1d96-4557-ab14-65e4ae2751d1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.837884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c9678-3dc2-452f-8716-6f4d128db9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.838709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9678-3dc2-452f-8716-6f4d128db9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.838996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9678-3dc2-452f-8716-6f4d128db9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.839449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c9678-3dc2-452f-8716-6f4d128db9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.840415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c9678-3dc2-452f-8716-6f4d128db9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.842243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c9678-3dc2-452f-8716-6f4d128db9c4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:13.864122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1148/2297] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:13.869532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:13.880992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa415eb-dd3e-4afc-936d-8f3d489859ca admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:13.886173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:13.887213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:13.887562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:13.888094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] PATH_INFO: `/v3/projects/fed02e7fc81c4a36a0d5c87132d56dc5/users/173a8e3cbc3b4926a213be2760dc9787/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:13.905566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed02e7fc81c4a36a0d5c87132d56dc5, user_id=173a8e3cbc3b4926a213be2760dc9787, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:13.908854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:14.057963 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1150/2298] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:13 2022] PUT /identity/v3/projects/fed02e7fc81c4a36a0d5c87132d56dc5/users/173a8e3cbc3b4926a213be2760dc9787/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:14.070269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f3d5-332f-4605-93e9-9cab8fa1e692 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:14.070587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f3d5-332f-4605-93e9-9cab8fa1e692 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:14.070886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72f3d5-332f-4605-93e9-9cab8fa1e692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:14.113057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8d72f3d5-332f-4605-93e9-9cab8fa1e692 None None] MFA Rules not processed for user `173a8e3cbc3b4926a213be2760dc9787`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:14.114472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8d72f3d5-332f-4605-93e9-9cab8fa1e692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:14.192765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1149/2299] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:14.203889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:14.206530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:14.278040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e6e54-bc1f-41d1-86ee-71acd393a438 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:14.289438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:14.289438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:14.289438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:14.289438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:14.292522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:14.294048 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:14.304874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1151/2300] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:14.563431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9a6e5-6903-440d-ae9c-d6b539973141 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:14.563431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9a6e5-6903-440d-ae9c-d6b539973141 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:14.563431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9a6e5-6903-440d-ae9c-d6b539973141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:14.594220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ace9a6e5-6903-440d-ae9c-d6b539973141 None None] MFA Rules not processed for user `eef05bfef54c43ca8d0099ee98986766`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:14.597344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ace9a6e5-6903-440d-ae9c-d6b539973141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:14.718677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1150/2301] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:15.003109 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:15.015013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f468848-83f6-4c6c-91b4-cba139968bda service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:15.019898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188f66-4303-45d2-9afe-39f544c2a1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:15.020879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188f66-4303-45d2-9afe-39f544c2a1aa service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:15.021210 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188f66-4303-45d2-9afe-39f544c2a1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:15.021532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188f66-4303-45d2-9afe-39f544c2a1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:15.036811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188f66-4303-45d2-9afe-39f544c2a1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:15.039493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188f66-4303-45d2-9afe-39f544c2a1aa service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:15.056797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1152/2302] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:16.437464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dac4-a0d2-4c2a-ba27-b458bc8d8715 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:16.438017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dac4-a0d2-4c2a-ba27-b458bc8d8715 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:16.438111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574dac4-a0d2-4c2a-ba27-b458bc8d8715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:16.458209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e574dac4-a0d2-4c2a-ba27-b458bc8d8715 None None] MFA Rules not processed for user `173a8e3cbc3b4926a213be2760dc9787`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:16.459462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e574dac4-a0d2-4c2a-ba27-b458bc8d8715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:16.466714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1151/2303] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:18.010867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:18.011951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:18.011951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:18.033932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] MFA Rules not processed for user `eef05bfef54c43ca8d0099ee98986766`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:18.033932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:18.040463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1153/2304] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:21.055882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38648ee-3cb7-448f-bf3a-a8734165fcc3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:21.055882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38648ee-3cb7-448f-bf3a-a8734165fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:21.055882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38648ee-3cb7-448f-bf3a-a8734165fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:21.072042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-a38648ee-3cb7-448f-bf3a-a8734165fcc3 None None] MFA Rules not processed for user `6f525569d9ed4d61926ddad83a270032`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:21.073451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a38648ee-3cb7-448f-bf3a-a8734165fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:21.138564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1152/2305] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:21.873903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:21.875385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:21.963732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cdf99-c325-45b2-bee3-a6f911ba0874 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:21.969275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:21.970301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:21.970582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:21.970859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] PATH_INFO: `/v3/users/6369e52f31104238b2323b84e0ad7fe6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:21.972140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6369e52f31104238b2323b84e0ad7fe6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:21.974091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:22.198120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6369e52f31104238b2323b84e0ad7fe6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:22.198716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6369e52f31104238b2323b84e0ad7fe6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:22.206634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6369e52f31104238b2323b84e0ad7fe6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:22.218986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6369e52f31104238b2323b84e0ad7fe6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:22.218986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6369e52f31104238b2323b84e0ad7fe6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:22.304900 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1154/2306] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:21 2022] DELETE /identity/v3/users/6369e52f31104238b2323b84e0ad7fe6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:22.309426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:22.309931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:22.310106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:22.330387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:22.331761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:22.398496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1153/2307] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:22.410253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:22.415735 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:22.486726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9031a5-d048-488f-889c-ee112f9e8d0f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:22.491241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5f4cd-ae98-4a2b-a4a8-890214c1c356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:22.492000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5f4cd-ae98-4a2b-a4a8-890214c1c356 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:22.492284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5f4cd-ae98-4a2b-a4a8-890214c1c356 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:22.492561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5f4cd-ae98-4a2b-a4a8-890214c1c356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:22.504771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5f4cd-ae98-4a2b-a4a8-890214c1c356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:22.506238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5f4cd-ae98-4a2b-a4a8-890214c1c356 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:22.518272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1155/2308] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:11:23.752892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:23.755211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:23.768664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a656f7-cf74-467b-8d56-9a61a8167207 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:23.787288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:23.788266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:23.788543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:23.788825 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] PATH_INFO: `/v3/projects/5a3a8be1d18e47c68cb76760339bd305` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:23.790844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3a8be1d18e47c68cb76760339bd305)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:23.793115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:24.029716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3a8be1d18e47c68cb76760339bd305', 'request_id': 'req-aaab8313-a132-41dc-a61c-7444c75111fe'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:24.044688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3a8be1d18e47c68cb76760339bd305', 'request_id': 'req-aaab8313-a132-41dc-a61c-7444c75111fe'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:24.148753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3a8be1d18e47c68cb76760339bd305', 'request_id': 'req-aaab8313-a132-41dc-a61c-7444c75111fe'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:24.164806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] The token cache is being invalidate because project 5a3a8be1d18e47c68cb76760339bd305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:24.165365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:24.166193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-aaab8313-a132-41dc-a61c-7444c75111fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:24.167880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1154/2309] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:23 2022] DELETE /identity/v3/projects/5a3a8be1d18e47c68cb76760339bd305 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:24.173544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.174530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.174967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.200436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:24.201838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:24.304634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1156/2310] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:24.323236 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.323777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.323939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.356019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:24.358717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:24.379259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1155/2311] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:24.380340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:24.393504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052b072-4fd0-46b7-8e44-01e864e83033 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:24.400796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:24.402323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.403325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.404178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.405099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:11:24.406592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:24.408998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:24.431826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1157/2312] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:11:24.441933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:24.453456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec084f6b-dfb3-4e58-8bf4-613ee7996e28 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:24.464489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:24.468240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.468240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.468240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.468240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:24.469472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:24.626614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1156/2313] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:11:24 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:24.638719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:24.655194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce533aa-d599-4f16-a31c-3e03e4445bc7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:24.757571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:24.758311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.758605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.759031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.760474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:24.763142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:24.899686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1158/2314] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:11:24 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:24.901162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:24.921266 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf7ce-1033-47d4-bdaf-89095ff50d0e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:24.929764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:24.930765 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.931771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.931771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.932256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:24.933861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:24.948544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1157/2315] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:11:24.953162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:24.968293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08018f0-7d3e-4b99-96a9-55cfb35fc408 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:24.976969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19fe83-30a7-43a6-8a09-188a6190fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:24.977791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19fe83-30a7-43a6-8a09-188a6190fbb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:24.978134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19fe83-30a7-43a6-8a09-188a6190fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:24.978972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19fe83-30a7-43a6-8a09-188a6190fbb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:24.981186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19fe83-30a7-43a6-8a09-188a6190fbb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:24.985124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19fe83-30a7-43a6-8a09-188a6190fbb1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:25.005225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1159/2316] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:11:25.008985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:25.029494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf57276-b5d9-458b-aed7-f6cd1266e2ca admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:25.052958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:25.053858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:25.054134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:25.054408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] PATH_INFO: `/v3/projects/d02f93286c9446d0b06f78c074ac9090/users/4b1ff26c717847359380b916424c2015/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:25.084355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02f93286c9446d0b06f78c074ac9090, user_id=4b1ff26c717847359380b916424c2015, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:25.087518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:25.221655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1158/2317] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:25 2022] PUT /identity/v3/projects/d02f93286c9446d0b06f78c074ac9090/users/4b1ff26c717847359380b916424c2015/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:25.227270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:25.227770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:25.227909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:25.261594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] MFA Rules not processed for user `4b1ff26c717847359380b916424c2015`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:25.262946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:25.365994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1160/2318] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:25.368441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:25.478315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da910c3f-8b43-4481-ae4b-619067c6c47a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:25.492031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:25.492733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:25.493020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:25.496227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:25.497308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:25.499425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:25.685644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1159/2319] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:11:25 2022] POST /identity/v3/projects => generated 377 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:25.692262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:25.712551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15ae19-2ef5-4adb-a987-a7a7ac8b1677 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:25.817015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:25.817706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:25.817999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:25.818285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:25.819354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:25.821761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:26.161770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1161/2320] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:11:25 2022] POST /identity/v3/users => generated 289 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:11:26.166368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:26.182068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2016b-05c7-4762-8d78-a05c1435df01 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:26.187843 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:26.189251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:26.189709 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:26.190020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:26.190783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:26.193162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:26.207043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1160/2321] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:11:26.211554 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:26.228380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63f69c-bf94-4192-b728-9ba0e65c4b62 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:26.236741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a0bf-3cf1-429f-8b3e-c7c09c0a608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:26.237874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a0bf-3cf1-429f-8b3e-c7c09c0a608c admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:26.238789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a0bf-3cf1-429f-8b3e-c7c09c0a608c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:26.239237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a0bf-3cf1-429f-8b3e-c7c09c0a608c admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:26.240254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833a0bf-3cf1-429f-8b3e-c7c09c0a608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:26.242080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833a0bf-3cf1-429f-8b3e-c7c09c0a608c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:26.256145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1162/2322] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:26.260361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:26.295399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ac443-3d30-4dd2-841e-57ac923ad502 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:26.310441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:26.312578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:26.312578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:26.312933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] PATH_INFO: `/v3/projects/e0847bbaed5b49638f822164ef5a0b22/users/e6e0a19258ca45099adeeaaff9090476/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:26.330903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0847bbaed5b49638f822164ef5a0b22, user_id=e6e0a19258ca45099adeeaaff9090476, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:26.346295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:26.411928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dccf92-a59c-49e6-aec3-41342fda217d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:26.412173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dccf92-a59c-49e6-aec3-41342fda217d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:26.412391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dccf92-a59c-49e6-aec3-41342fda217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:26.433460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-79dccf92-a59c-49e6-aec3-41342fda217d None None] MFA Rules not processed for user `70516383f3b14d5283462803cac26d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:26.440720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-79dccf92-a59c-49e6-aec3-41342fda217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:26.507935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1163/2323] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:26.526718 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1161/2324] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:26 2022] PUT /identity/v3/projects/e0847bbaed5b49638f822164ef5a0b22/users/e6e0a19258ca45099adeeaaff9090476/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:26.536316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996827-1021-45e9-bb91-d52b5014939f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:26.536607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996827-1021-45e9-bb91-d52b5014939f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:26.536888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996827-1021-45e9-bb91-d52b5014939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:26.576591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-46996827-1021-45e9-bb91-d52b5014939f None None] MFA Rules not processed for user `e6e0a19258ca45099adeeaaff9090476`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:26.577882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-46996827-1021-45e9-bb91-d52b5014939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:26.695796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1164/2325] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:26.700210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:26.862907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550baf84-0204-4ff1-bc09-a4a22468edbe admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:26.868504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:26.869625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:26.870125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:26.870494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:26.871615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:26.874470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:27.013609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1162/2326] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:11:26 2022] POST /identity/v3/projects => generated 373 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:27.019994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996827-1021-45e9-bb91-d52b5014939f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:27.040832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996827-1021-45e9-bb91-d52b5014939f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:27.185725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:27.186428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:27.186683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:27.187005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:27.187633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:27.194756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:27.454765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1165/2327] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:11:27 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:27.458453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:27.470900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5aed9c-441d-47b5-8793-67f22cf79b56 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:27.477918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:27.478208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:27.478354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:27.478584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:27.479474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:27.481441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:27.506940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1163/2328] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:27.511446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:27.529992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42165e8-279b-4d5a-80b0-1ae13ef02193 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:27.552370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:27.553356 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:27.555059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:27.555371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] PATH_INFO: `/v3/projects/65690f2d4aa7463c885bcd246c8c28b3/users/588f638e14f84739bc752cb6912e6945/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:27.585325 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65690f2d4aa7463c885bcd246c8c28b3, user_id=588f638e14f84739bc752cb6912e6945, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:27.588569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:27.732103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1166/2329] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:27 2022] PUT /identity/v3/projects/65690f2d4aa7463c885bcd246c8c28b3/users/588f638e14f84739bc752cb6912e6945/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:27.742060 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:27.753559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6a8e-597f-41a6-b12b-6f83e3703e34 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:27.815100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0981e-84e4-49af-9007-46a1d73f28a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:27.815773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0981e-84e4-49af-9007-46a1d73f28a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:27.816098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0981e-84e4-49af-9007-46a1d73f28a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:27.816422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0981e-84e4-49af-9007-46a1d73f28a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:27.817116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0981e-84e4-49af-9007-46a1d73f28a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:27.818786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0981e-84e4-49af-9007-46a1d73f28a2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:27.836795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1164/2330] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:27.839669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:27.854589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5697694-a814-4c18-b323-a070a569ab2f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:27.862538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:27.864300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:27.865641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:27.866474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] PATH_INFO: `/v3/projects/65690f2d4aa7463c885bcd246c8c28b3/users/588f638e14f84739bc752cb6912e6945/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:27.869007 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65690f2d4aa7463c885bcd246c8c28b3, user_id=588f638e14f84739bc752cb6912e6945, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:27.887583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:27.936964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:27.937258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:27.937540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:27.940354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1167/2331] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:27 2022] PUT /identity/v3/projects/65690f2d4aa7463c885bcd246c8c28b3/users/588f638e14f84739bc752cb6912e6945/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:27.972524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] MFA Rules not processed for user `588f638e14f84739bc752cb6912e6945`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:27.974184 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:28.093618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1165/2332] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:28.112303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:28.115043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:28.192825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f19bd-2be4-4d13-846b-126e9110791e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:28.199395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:28.200565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:28.201012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:28.201198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:28.259613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:28.261137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:28.279977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1168/2333] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:30.780965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:30.783030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:30.795812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8e084-7935-4eeb-a4ad-4443034a21f1 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:30.800255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:30.800926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:30.801314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:30.801486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:30.867566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:30.869823 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:30.881072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1166/2334] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:11:32.826511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:32.843313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3646c-e088-4ca1-986d-43505d84a244 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:32.850550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360a79c-3897-47e5-9322-8b237afff9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:32.851609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a79c-3897-47e5-9322-8b237afff9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:32.852295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a79c-3897-47e5-9322-8b237afff9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:32.853065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a79c-3897-47e5-9322-8b237afff9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:32.868336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360a79c-3897-47e5-9322-8b237afff9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:32.869968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360a79c-3897-47e5-9322-8b237afff9b7 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:32.894931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1169/2335] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:37.848900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:37.986212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34cd27-f561-42d1-abdd-fa8ebcfa761a service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:37.992489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:37.993645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:37.994049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:37.994459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] PATH_INFO: `/v3/users/4b1ff26c717847359380b916424c2015` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:37.995914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1ff26c717847359380b916424c2015)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:37.998601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:38.302428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1ff26c717847359380b916424c2015'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:38.309264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1ff26c717847359380b916424c2015'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:38.321615 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1ff26c717847359380b916424c2015'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:38.322347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1ff26c717847359380b916424c2015'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:38.323683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1ff26c717847359380b916424c2015'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:38.446589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1167/2336] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:37 2022] DELETE /identity/v3/users/4b1ff26c717847359380b916424c2015 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:38.452409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:38.453326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:38.453635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:38.472307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:38.473582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:38.540234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1170/2337] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:38.551386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:38.552842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:38.613818 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd190cc-cb53-484f-be66-784f7e8df908 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:38.619389 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:38.621304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:38.621596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:38.621874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:38.632926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:38.634383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:38.647533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1168/2338] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:39.141065 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:39.143307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:39.164251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ab0b-1c3b-4e94-86b2-7e5a0dd0c338 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:39.173406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:39.176765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:39.179078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:39.179688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] PATH_INFO: `/v3/projects/d02f93286c9446d0b06f78c074ac9090` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:39.183054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02f93286c9446d0b06f78c074ac9090)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:39.188060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:39.374233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02f93286c9446d0b06f78c074ac9090', 'request_id': 'req-b8e5a9a6-913a-4835-96ff-9fe5631585ba'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.381881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02f93286c9446d0b06f78c074ac9090', 'request_id': 'req-b8e5a9a6-913a-4835-96ff-9fe5631585ba'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.388710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02f93286c9446d0b06f78c074ac9090', 'request_id': 'req-b8e5a9a6-913a-4835-96ff-9fe5631585ba'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.504971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] The token cache is being invalidate because project d02f93286c9446d0b06f78c074ac9090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:39.506057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.506610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b8e5a9a6-913a-4835-96ff-9fe5631585ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.508796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1171/2339] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:39 2022] DELETE /identity/v3/projects/d02f93286c9446d0b06f78c074ac9090 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:39.514065 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:39.529506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbcc50-db48-4971-8003-74c58362910e service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:39.630259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:39.631547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:39.632086 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:39.632728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] PATH_INFO: `/v3/users/e6e0a19258ca45099adeeaaff9090476` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:39.634326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e0a19258ca45099adeeaaff9090476)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:39.636627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:39.693620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:39.693910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:39.694376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:39.733323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:39.734556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:39.800472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1172/2340] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:39.828926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e0a19258ca45099adeeaaff9090476'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.837471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e0a19258ca45099adeeaaff9090476'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.852066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:39.853684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:39.864853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e0a19258ca45099adeeaaff9090476'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.868490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e0a19258ca45099adeeaaff9090476'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.869269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e0a19258ca45099adeeaaff9090476'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:39.937682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee65f2-f2e9-4dec-97a3-0585db556b71 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:39.943175 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:39.943461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1169/2341] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:39 2022] DELETE /identity/v3/users/e6e0a19258ca45099adeeaaff9090476 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:39.943844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:39.944149 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:39.944429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:39.946316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:39.958009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:39.959609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:39.971314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1173/2342] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:11:40.529009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:40.531463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:40.650258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264e4f2-02c7-4ff0-a726-63f245346774 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:40.655868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:40.657176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:40.658982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:40.659342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] PATH_INFO: `/v3/projects/e0847bbaed5b49638f822164ef5a0b22` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:40.660774 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0847bbaed5b49638f822164ef5a0b22)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:40.665251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:40.797131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0847bbaed5b49638f822164ef5a0b22', 'request_id': 'req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:40.804145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0847bbaed5b49638f822164ef5a0b22', 'request_id': 'req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:40.895747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0847bbaed5b49638f822164ef5a0b22', 'request_id': 'req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:40.908812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] The token cache is being invalidate because project e0847bbaed5b49638f822164ef5a0b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:40.909099 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:40.910091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-85ba28a8-5e44-416c-8490-4cb0a5a50bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:40.911815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1170/2343] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:40 2022] DELETE /identity/v3/projects/e0847bbaed5b49638f822164ef5a0b22 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:40.916401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:40.927819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd77fe-6b4c-43b8-b42a-de9c2fdbee8a service swift] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:40.988476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:40.989365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:40.989653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:40.989939 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] PATH_INFO: `/v3/users/588f638e14f84739bc752cb6912e6945` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:40.991172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=588f638e14f84739bc752cb6912e6945)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:40.993262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:41.036926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:41.037275 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:41.037688 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:41.056608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:41.057865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:41.119698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1171/2344] 10.222.0.91 () {58 vars in 967 bytes} [Mon Feb 21 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:41.132556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:41.134147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:41.175481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588f638e14f84739bc752cb6912e6945'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:41.176594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588f638e14f84739bc752cb6912e6945'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:41.184418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588f638e14f84739bc752cb6912e6945'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:41.196907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588f638e14f84739bc752cb6912e6945'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:41.197715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-b0b8c40e-c74d-4a73-95c2-a78bef79b7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588f638e14f84739bc752cb6912e6945'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:41.213201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a92b4-59e6-470a-8f53-8327adfeab64 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:41.218661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:41.219360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:41.220192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:41.220466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:41.222439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:41.234171 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:41.237669 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:41.247263 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1172/2345] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:11:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:11:41.342556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1174/2346] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:40 2022] DELETE /identity/v3/users/588f638e14f84739bc752cb6912e6945 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:41.849647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:41.851209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:41.865399 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99078fe5-f558-48af-bb23-5adc29387518 service swift] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:41.944289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:41.944289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:41.944654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:41.944856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] PATH_INFO: `/v3/projects/65690f2d4aa7463c885bcd246c8c28b3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:41.946240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65690f2d4aa7463c885bcd246c8c28b3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:41.948277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.028771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.030579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.030579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.048541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:42.049788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:42.076897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65690f2d4aa7463c885bcd246c8c28b3', 'request_id': 'req-400d7ec8-956c-45d3-b3f2-60288739a4e0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:42.082531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65690f2d4aa7463c885bcd246c8c28b3', 'request_id': 'req-400d7ec8-956c-45d3-b3f2-60288739a4e0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:42.111090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1175/2347] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:42.122933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.124379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:42.141132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65690f2d4aa7463c885bcd246c8c28b3', 'request_id': 'req-400d7ec8-956c-45d3-b3f2-60288739a4e0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:42.153652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] The token cache is being invalidate because project 65690f2d4aa7463c885bcd246c8c28b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:42.154036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:42.154762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-400d7ec8-956c-45d3-b3f2-60288739a4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:42.156878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1173/2348] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:41 2022] DELETE /identity/v3/projects/65690f2d4aa7463c885bcd246c8c28b3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:42.161768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a462-4140-493c-9774-3d0299dc9134 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.162055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a462-4140-493c-9774-3d0299dc9134 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.162340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a462-4140-493c-9774-3d0299dc9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.196039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3244a462-4140-493c-9774-3d0299dc9134 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:42.198702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3244a462-4140-493c-9774-3d0299dc9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:42.215120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a79ea7-f41d-4e65-8ebf-de8895408e18 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.262189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1174/2349] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:42.273180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.273472 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.273750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.292657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:42.293205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.293868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.294124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:42.294225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.294521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.296392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:42.303336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1175/2350] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:11:42.307462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.319876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a5c0d-18ae-40c8-8216-6d91205e3b29 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.325043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.325815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.326114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.326505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.327318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:11:42.327702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.329786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.342561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1176/2351] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:11:42.347271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.357849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff37fd-5475-4251-a6ab-8358997bf356 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.363435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.365086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.366680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.370011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.370011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.370011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.370011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.370746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.375250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1176/2352] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 01:11:42.522811 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1177/2353] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:11:42 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:11:42.526641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.538147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c60a65-57bf-4ac9-8fb0-5707f6405ddd service swift] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.607718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.608429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.608712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.608987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.609674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.612321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.737756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1177/2354] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:11:42 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:11:42.742291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.755336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f637069-a6a8-47cd-827f-cc32e461e9d2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.765776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.765776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.765776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.765776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.766479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.766479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.779595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1178/2355] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:11:42.784665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.795596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7340b-77cc-4805-a6c9-41600f7c968b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.801113 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ec1fa-38c5-45ab-9de8-8ac6b90f4476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.801874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec1fa-38c5-45ab-9de8-8ac6b90f4476 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.802394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec1fa-38c5-45ab-9de8-8ac6b90f4476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.802677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ec1fa-38c5-45ab-9de8-8ac6b90f4476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.803513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ec1fa-38c5-45ab-9de8-8ac6b90f4476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.805254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ec1fa-38c5-45ab-9de8-8ac6b90f4476 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.816654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1178/2356] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:11:42.820415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:42.831233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90440e17-edd2-4654-b805-c50c5667a85d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:42.838516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:42.839460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.839742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.840046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] PATH_INFO: `/v3/projects/6014d3ab6c2340118e3169042219b569/users/569bed6ed79c4896a66f52f0b5875f3c/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:42.867021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6014d3ab6c2340118e3169042219b569, user_id=569bed6ed79c4896a66f52f0b5875f3c, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:42.869837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:42.958256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1179/2357] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:11:42 2022] PUT /identity/v3/projects/6014d3ab6c2340118e3169042219b569/users/569bed6ed79c4896a66f52f0b5875f3c/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:11:42.968725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cef1c-6d26-43ab-b01e-e49ae9a9039a None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:42.969031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cef1c-6d26-43ab-b01e-e49ae9a9039a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:42.969321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cef1c-6d26-43ab-b01e-e49ae9a9039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:43.006063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-278cef1c-6d26-43ab-b01e-e49ae9a9039a None None] MFA Rules not processed for user `569bed6ed79c4896a66f52f0b5875f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:43.007286 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-278cef1c-6d26-43ab-b01e-e49ae9a9039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:43.111809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1179/2358] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:43.124042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:43.125815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:43.200974 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf6063-79f8-445e-98c1-bfaac87d04aa admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:43.205874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:43.206554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:43.206895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:43.207239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:43.215902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:43.217331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:43.226894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1180/2359] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:43.382702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:43.382896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:43.383169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:43.409908 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:43.411141 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:43.484427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1180/2360] 10.222.0.91 () {58 vars in 967 bytes} [Mon Feb 21 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:43.501812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:43.503410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:43.578933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2f911-cb38-47df-9e0b-8b585649026f service glance] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:43.584860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:43.585536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:43.585829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:43.586104 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:43.594569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:43.596738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:43.606457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1181/2361] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:11:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:11:46.620698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:46.622280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:46.682027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f8f2-3611-4b50-84e7-6ae1bc305152 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:46.685934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:46.686578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:46.686860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:46.687137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:46.689836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:46.758426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:46.760123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1ebfe-1a90-4511-91d0-b72a4fa9374f service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:46.770471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1181/2362] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:46.921977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:46.924261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:46.998339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e046b39-5e79-46bc-8cc5-34f51b473df8 service swift] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:47.005951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:47.006998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:47.007290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:47.007576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] PATH_INFO: `/v3/users/173a8e3cbc3b4926a213be2760dc9787` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:47.009004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173a8e3cbc3b4926a213be2760dc9787)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:47.010932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:47.203079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173a8e3cbc3b4926a213be2760dc9787'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:47.212046 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173a8e3cbc3b4926a213be2760dc9787'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:47.226180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173a8e3cbc3b4926a213be2760dc9787'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:47.227629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173a8e3cbc3b4926a213be2760dc9787'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:47.228394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173a8e3cbc3b4926a213be2760dc9787'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:47.308378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1182/2363] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:11:46 2022] DELETE /identity/v3/users/173a8e3cbc3b4926a213be2760dc9787 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:11:47.314646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:47.314951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:47.315197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:47.334061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:11:47.335275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:47.413214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1182/2364] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:11:47.423235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:47.424796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:47.488967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c88dd-8c8e-41df-8428-f789ed7157d3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:47.492904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:47.493594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:47.493890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:47.494173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:47.504158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:47.505591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:47.515335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1183/2365] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:11:48.236083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:11:48.237568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:11:48.249474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0db66-6fcf-445a-94ac-63e637db6a47 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:11:48.254644 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:11:48.255574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:11:48.255887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:11:48.256169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] PATH_INFO: `/v3/projects/fed02e7fc81c4a36a0d5c87132d56dc5` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:11:48.257365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed02e7fc81c4a36a0d5c87132d56dc5)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:11:48.261241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:11:48.415464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'request_id': 'req-7a960e34-139b-43db-a0fd-95e178078a26'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:48.422107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'request_id': 'req-7a960e34-139b-43db-a0fd-95e178078a26'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:48.433041 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed02e7fc81c4a36a0d5c87132d56dc5', 'request_id': 'req-7a960e34-139b-43db-a0fd-95e178078a26'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:48.526091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] The token cache is being invalidate because project fed02e7fc81c4a36a0d5c87132d56dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:11:48.526392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:48.527067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7a960e34-139b-43db-a0fd-95e178078a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:11:48.528728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1183/2366] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:11:48 2022] DELETE /identity/v3/projects/fed02e7fc81c4a36a0d5c87132d56dc5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:12:13.539347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:13.540938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:13.659092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31679d7-d141-42f0-8545-672dbc17fcaf service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:13.727121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:13.727872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:13.728166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:13.728450 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:13.730316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:13.744001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:13.745588 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:13.756578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1184/2367] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:12:36.171263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90447ef-7c0c-440d-aaf5-50c42dc1b719 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:36.171938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90447ef-7c0c-440d-aaf5-50c42dc1b719 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:36.171938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90447ef-7c0c-440d-aaf5-50c42dc1b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:36.234127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f90447ef-7c0c-440d-aaf5-50c42dc1b719 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:12:36.235358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f90447ef-7c0c-440d-aaf5-50c42dc1b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:36.301496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1184/2368] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:12:36.314128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:36.316763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:36.418911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5076-5044-480a-9b88-c739e9b69a89 service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:36.424285 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47d0ad-0689-4dbc-8d94-a5a3fe06a6c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:36.425084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d0ad-0689-4dbc-8d94-a5a3fe06a6c7 service swift] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:36.425378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d0ad-0689-4dbc-8d94-a5a3fe06a6c7 service swift] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:36.425664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47d0ad-0689-4dbc-8d94-a5a3fe06a6c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:36.434359 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47d0ad-0689-4dbc-8d94-a5a3fe06a6c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:36.435997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47d0ad-0689-4dbc-8d94-a5a3fe06a6c7 service swift] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:36.445874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1185/2369] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:12:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:12:53.957370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680305c7-2fa3-4275-ac5e-3b410e0e30b4 None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:53.958017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680305c7-2fa3-4275-ac5e-3b410e0e30b4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:53.958017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680305c7-2fa3-4275-ac5e-3b410e0e30b4 None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:53.959935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1185/2370] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:12:53.966217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff30b3-e3ad-4e2a-9d30-4d92d9ccb484 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:53.966803 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff30b3-e3ad-4e2a-9d30-4d92d9ccb484 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:53.967467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff30b3-e3ad-4e2a-9d30-4d92d9ccb484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.043982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8eff30b3-e3ad-4e2a-9d30-4d92d9ccb484 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:12:54.046125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8eff30b3-e3ad-4e2a-9d30-4d92d9ccb484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:54.129891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1186/2371] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:12:54.141215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680305c7-2fa3-4275-ac5e-3b410e0e30b4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:54.142925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-680305c7-2fa3-4275-ac5e-3b410e0e30b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:54.231598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680305c7-2fa3-4275-ac5e-3b410e0e30b4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:54.235385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29200ff7-4415-446d-8f8f-d7fed08bbdd5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:54.238382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200ff7-4415-446d-8f8f-d7fed08bbdd5 service glance] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.238382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200ff7-4415-446d-8f8f-d7fed08bbdd5 service glance] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.238382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200ff7-4415-446d-8f8f-d7fed08bbdd5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.251358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29200ff7-4415-446d-8f8f-d7fed08bbdd5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:54.253484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29200ff7-4415-446d-8f8f-d7fed08bbdd5 service glance] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:54.265703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1186/2372] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:12:54.499154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe6c6-00e0-4196-b5fe-cde837674510 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.499443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe6c6-00e0-4196-b5fe-cde837674510 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.499728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbe6c6-00e0-4196-b5fe-cde837674510 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.501582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1187/2373] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:12:54.507071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb3ab-aed3-4340-ae9b-1d01903cd30e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.507371 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb3ab-aed3-4340-ae9b-1d01903cd30e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.507643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb3ab-aed3-4340-ae9b-1d01903cd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.528603 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c21eb3ab-aed3-4340-ae9b-1d01903cd30e None None] MFA Rules not processed for user `84fdc361782f47a2976d393a6b5e1397`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:12:54.530611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c21eb3ab-aed3-4340-ae9b-1d01903cd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:54.590594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1187/2374] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:12:54.603185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbe6c6-00e0-4196-b5fe-cde837674510 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:54.605001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-68dbe6c6-00e0-4196-b5fe-cde837674510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:54.619739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbe6c6-00e0-4196-b5fe-cde837674510 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:54.623441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a589e-b23a-4c59-a6e6-b2ceb3be14f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:54.624122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a589e-b23a-4c59-a6e6-b2ceb3be14f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.624409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a589e-b23a-4c59-a6e6-b2ceb3be14f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.624689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a589e-b23a-4c59-a6e6-b2ceb3be14f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.635242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a589e-b23a-4c59-a6e6-b2ceb3be14f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:54.636737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a589e-b23a-4c59-a6e6-b2ceb3be14f0 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:54.645632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1188/2375] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:12:54.740202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ff3b9-05fc-4bca-9948-b6ba82693f6a None None] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.740500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ff3b9-05fc-4bca-9948-b6ba82693f6a None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.740815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ff3b9-05fc-4bca-9948-b6ba82693f6a None None] PATH_INFO: `/` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.742619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1188/2376] 10.222.0.91 () {54 vars in 921 bytes} [Mon Feb 21 01:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 01:12:54.747535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.747827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.748146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.768035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] MFA Rules not processed for user `0d58bb9324d548b9b0e5fec7ae458a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:12:54.769255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:12:54.778771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1189/2377] 10.222.0.91 () {58 vars in 1018 bytes} [Mon Feb 21 01:12:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:12:54.790479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ff3b9-05fc-4bca-9948-b6ba82693f6a None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:12:54.801928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ff3b9-05fc-4bca-9948-b6ba82693f6a None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:12:54.805605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:12:54.806228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:12:54.806509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:12:54.806787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:12:54.817341 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:12:54.818756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:12:54.829432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1189/2378] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:12:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:07.585220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:07.586783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:07.597918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd9fc4-aee3-4f09-8893-b81a5e6ffc38 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:07.601456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:07.602090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:07.602371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:07.603179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:07.604923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:07.617787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:07.619763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:07.630937 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1190/2379] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:08.733762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:08.742354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f7d6e-7b47-4e31-8427-f908533523e0 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:08.746220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:08.746838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:08.747119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:08.747396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:08.749161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:08.762059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:08.763456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:08.774130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1190/2380] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:14:14.188480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:14:14.189884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:14.203947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd49058-874c-4386-9c36-9fc9b9118a1f service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:14:14.209390 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:14:14.210004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:14:14.210293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:14:14.210565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:14:14.212300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:14:14.270002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:14:14.271643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:14:14.281558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1191/2381] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:02.025172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:02.027500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:02.106441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf655-4dd1-45ab-b88a-8b775871a55a service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:02.110144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:02.110785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:02.111069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:02.111350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:02.113157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:02.171156 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:02.175509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:02.181539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1191/2382] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:13.390128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:13.399308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d5a8d-f3e0-4fc7-b513-a4bbc4885426 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:13.402997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:13.403629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:13.403936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:13.404272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:13.406277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:13.416306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:13.417726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:13.426862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1192/2383] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:15:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:22.945475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:22.946956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:22.962702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1d38f-5f7d-4e02-b05c-78a351831e6b service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:22.969075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:22.969704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:22.969988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:22.970265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:22.972117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:23.031221 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:23.032841 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:23.041953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1192/2384] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:15:46.558886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:15:46.572100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559f8c-eee8-47c7-bd5f-82899b26a53c service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:15:46.577740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:15:46.578817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:15:46.579117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:15:46.579405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:15:46.581244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:15:46.643007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:15:46.643007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:15:46.652431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1193/2385] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:17:02.399790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:02.410555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce5d37-bae1-44d8-8777-d4321a13879d service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:02.414446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:02.415011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:02.415296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:02.415576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:02.417822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:02.477567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:02.479013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:02.488507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1193/2386] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:17:02.512939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:02.522420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc70a78-bbf3-4d89-b984-71b55831ee79 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:02.525955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:02.526578 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:02.526858 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:02.527131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:02.529138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:02.587979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:02.589415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:02.598464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1194/2387] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:17:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:17:17.953884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:17:17.955419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:17:17.970383 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0046e75-0fc9-43e4-9b1b-7f1a488b64dc service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:17:17.977049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:17:17.977698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:17:17.978032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:17:17.978273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:17:17.988681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:17:17.990193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:17:18.002599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1194/2388] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:01.802759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:01.804264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:01.816071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28374850-f4fb-4946-af52-336fc34b25c1 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:01.819788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:01.825063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:01.825063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:01.825063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:01.831779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:01.833271 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:01.845762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1195/2389] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:01.896755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:01.906764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d49c8d-f97a-4a43-9ff6-edee815342dc service placement] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:01.911281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:01.911946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:01.912238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:01.912518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:01.924828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:01.926265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:01.937443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1195/2390] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:01.987197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:01.995611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32fdc8-a267-45b3-bda2-ff0cab8d79cd service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:01.999922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:02.000703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:02.001079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:02.001457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:02.011344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:02.012892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:02.043942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1196/2391] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:02.087874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:02.100968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398403c-9b6a-4ed8-875a-b7c188c20538 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:02.107549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:02.108232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:02.108520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:02.108997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:02.118571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:02.120445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:02.152022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1196/2392] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:02.196531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:02.196732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:02.202443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccda23-6bcd-4c87-bb79-ffc51c8103b8 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:02.204569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01785677-159f-45cf-ba5b-98f97c450977 service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:02.208855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:02.209360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:02.209514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:02.209752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:02.209999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:02.210105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:02.210282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:02.210600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:02.212106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:02.212492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:02.225096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:02.226693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:02.238091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1197/2393] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:02.285389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:02.286844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:02.297558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1197/2394] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:20:02.996505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:02.997857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:03.011621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747b2e7-180d-4528-b19b-7c5336170253 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:03.017210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:03.018236 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:03.018507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:03.018790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] PATH_INFO: `/v3/users/70516383f3b14d5283462803cac26d8b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:03.034297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70516383f3b14d5283462803cac26d8b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:03.036334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:03.182644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70516383f3b14d5283462803cac26d8b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.190091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70516383f3b14d5283462803cac26d8b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.202162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70516383f3b14d5283462803cac26d8b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.202853 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70516383f3b14d5283462803cac26d8b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.203459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-45495cc9-ac6e-49a5-b3c9-2483f68b0538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70516383f3b14d5283462803cac26d8b'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.288350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1198/2395] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:20:02 2022] DELETE /identity/v3/users/70516383f3b14d5283462803cac26d8b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:20:03.542682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:03.553124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae374-ca14-40f2-8657-37bc391c65d8 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:03.623569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:03.631319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:03.631319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:03.631319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] PATH_INFO: `/v3/projects/24c1bf236b2f4eb1bffab124b7392ca5` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:03.631319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c1bf236b2f4eb1bffab124b7392ca5)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:03.631319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:03.733745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c1bf236b2f4eb1bffab124b7392ca5', 'request_id': 'req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.740204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c1bf236b2f4eb1bffab124b7392ca5', 'request_id': 'req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.745664 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c1bf236b2f4eb1bffab124b7392ca5', 'request_id': 'req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.831613 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] The token cache is being invalidate because project 24c1bf236b2f4eb1bffab124b7392ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:20:03.831921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.832633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4d063d0f-f9c2-4e8d-8055-781ebcdac0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:03.834198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1198/2396] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:20:03 2022] DELETE /identity/v3/projects/24c1bf236b2f4eb1bffab124b7392ca5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:20:03.841866 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:03.842178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:03.842437 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:03.860746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:03.862016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:03.920808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1199/2397] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:03.929043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:03.929332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:03.929696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:03.948116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:03.949310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:03.957955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1199/2398] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:03.962309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:03.972572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c0b5-5296-4150-84c8-7ad640ee9d4a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:03.977237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:03.977889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:03.978176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:03.978453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:03.979174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:20:03.979484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:03.981108 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:03.993571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1200/2399] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:20:03.997648 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:04.007941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ba252-3754-47d6-8b69-4508107fa19d None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:04.012679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:04.013315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.013601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.013879 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.014593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:04.016526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:04.106229 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1200/2400] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:20:03 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:20:04.110459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:04.121354 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8de89a-a15c-464e-866e-cffad97ff37b admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:04.177089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:04.177755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.178041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.178324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.179012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:04.180948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:04.301349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1201/2401] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:20:04 2022] POST /identity/v3/users => generated 303 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:20:04.305128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:04.316398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9b220-cf2a-488a-85fe-47c88613afd8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:04.321086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:04.321742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.322029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.322313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.323050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:04.324718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:04.334693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1201/2402] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:20:04.338700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:04.349247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac703e-4733-4655-a55d-023a21bac4d2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:04.353976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d23c24-43e0-4c23-ba27-72deaa95f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:04.354636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d23c24-43e0-4c23-ba27-72deaa95f539 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.354919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d23c24-43e0-4c23-ba27-72deaa95f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.355205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d23c24-43e0-4c23-ba27-72deaa95f539 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.355962 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d23c24-43e0-4c23-ba27-72deaa95f539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:04.357572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d23c24-43e0-4c23-ba27-72deaa95f539 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:04.368129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1202/2403] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:20:04.372467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:04.382557 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc4b29-9518-4693-8499-b3c1b08f13be admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:04.387186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:04.388084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.388374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.388653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] PATH_INFO: `/v3/projects/e79ed78ed6a04aaa82dbf6fd46cc460d/users/44bc10f397bd47278de148e3f5b8ab4d/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.403967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79ed78ed6a04aaa82dbf6fd46cc460d, user_id=44bc10f397bd47278de148e3f5b8ab4d, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:04.406640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:04.495544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1202/2404] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:20:04 2022] PUT /identity/v3/projects/e79ed78ed6a04aaa82dbf6fd46cc460d/users/44bc10f397bd47278de148e3f5b8ab4d/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:20:04.501009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51870-bc1c-42d8-8957-d443ab040a3e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.501304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51870-bc1c-42d8-8957-d443ab040a3e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.501655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51870-bc1c-42d8-8957-d443ab040a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.520328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-35d51870-bc1c-42d8-8957-d443ab040a3e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:04.526053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-35d51870-bc1c-42d8-8957-d443ab040a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:04.581972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1203/2405] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:04.591608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:04.593416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:04.651559 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ff0cc-0bec-4ff0-8bb3-2d08d7364755 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:04.655322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:04.656021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:04.656300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:04.656576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:04.667398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:04.668860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:04.678693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1203/2406] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:20:06.066288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.066861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.066861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.095069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] MFA Rules not processed for user `44bc10f397bd47278de148e3f5b8ab4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:06.099884 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:06.163660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1204/2407] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:06.168297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:06.178734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54bcd11-4b3f-4a52-9f7f-2bc18fe0231c service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:06.183620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:06.184529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.184815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.185092 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.186019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:06.188120 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:06.278705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1204/2408] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:20:06 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:20:06.282909 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:06.295291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c86bc4-faaa-4722-808a-1da3df5e02ec None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:06.350324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:06.350986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.351273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.351565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.352287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:06.354195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:06.431374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1205/2409] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:20:06 2022] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:20:06.435153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:06.445628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754180-6bfc-4b50-927a-f0fd9403e96d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:06.450360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:06.451012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.451298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.451577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.452349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:06.453958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:06.465345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1205/2410] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:20:06.469448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:06.480507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ff79-9d1b-470f-9a4a-711a2f074124 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:06.485325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:06.486324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.486955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.487238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] PATH_INFO: `/v3/projects/142c956789bc4a4d911af0a0862776a7/users/594abd7dd9be464eb98613d9489411b2/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.503613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142c956789bc4a4d911af0a0862776a7, user_id=594abd7dd9be464eb98613d9489411b2, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:06.508183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:06.558163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1206/2411] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:20:06 2022] PUT /identity/v3/projects/142c956789bc4a4d911af0a0862776a7/users/594abd7dd9be464eb98613d9489411b2/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:06.562073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:06.572216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621a597-56ff-4139-8d59-a935d9780a5f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:06.641233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4e59-23ee-48b1-854c-f31d9a2365d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:06.641901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4e59-23ee-48b1-854c-f31d9a2365d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.642184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4e59-23ee-48b1-854c-f31d9a2365d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.642462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4e59-23ee-48b1-854c-f31d9a2365d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.643935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b4e59-23ee-48b1-854c-f31d9a2365d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:06.645529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b4e59-23ee-48b1-854c-f31d9a2365d7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:06.656060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1206/2412] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:20:06.660772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:06.671008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c817d6a-7d1a-4de5-8f2a-e49bb581b624 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:06.676613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:06.677492 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:06.677773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:06.678047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] PATH_INFO: `/v3/projects/142c956789bc4a4d911af0a0862776a7/users/594abd7dd9be464eb98613d9489411b2/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:06.680113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142c956789bc4a4d911af0a0862776a7, user_id=594abd7dd9be464eb98613d9489411b2, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:06.682849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:06.694278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1207/2413] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:20:06 2022] PUT /identity/v3/projects/142c956789bc4a4d911af0a0862776a7/users/594abd7dd9be464eb98613d9489411b2/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:07.870688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:07.873368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:07.873368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:07.902190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] MFA Rules not processed for user `594abd7dd9be464eb98613d9489411b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:07.903456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:07.983328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1207/2414] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:09.511756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:09.573686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248109f-af7f-485c-8e03-19ffc1a10dc1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:09.578188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:09.579041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:09.579327 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:09.579607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] PATH_INFO: `/v3/users/44bc10f397bd47278de148e3f5b8ab4d` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:09.581714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bc10f397bd47278de148e3f5b8ab4d)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:09.583610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:09.798228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bc10f397bd47278de148e3f5b8ab4d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:09.805660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bc10f397bd47278de148e3f5b8ab4d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:09.818017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bc10f397bd47278de148e3f5b8ab4d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:09.818746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bc10f397bd47278de148e3f5b8ab4d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:09.819364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bc10f397bd47278de148e3f5b8ab4d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:09.893639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1208/2415] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:20:09 2022] DELETE /identity/v3/users/44bc10f397bd47278de148e3f5b8ab4d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:10.152844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:10.163941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edd60b-94a4-47aa-8511-42b21c667a6c None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:10.240368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:10.241651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:10.242176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:10.242695 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] PATH_INFO: `/v3/projects/e79ed78ed6a04aaa82dbf6fd46cc460d` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:10.244860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79ed78ed6a04aaa82dbf6fd46cc460d)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:10.248275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:10.353881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79ed78ed6a04aaa82dbf6fd46cc460d', 'request_id': 'req-cf5f5a2a-07e5-49fc-a318-271258bb0b59'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.361180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79ed78ed6a04aaa82dbf6fd46cc460d', 'request_id': 'req-cf5f5a2a-07e5-49fc-a318-271258bb0b59'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.367935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79ed78ed6a04aaa82dbf6fd46cc460d', 'request_id': 'req-cf5f5a2a-07e5-49fc-a318-271258bb0b59'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.453546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] The token cache is being invalidate because project e79ed78ed6a04aaa82dbf6fd46cc460d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:20:10.453750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.454398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.457266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1208/2416] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:20:10 2022] DELETE /identity/v3/projects/e79ed78ed6a04aaa82dbf6fd46cc460d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:10.461495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:10.462989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:10.475987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f1c7-e300-4b5a-8db4-d2e0f3c39862 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:10.531876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:10.532744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:10.533062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:10.533329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] PATH_INFO: `/v3/users/594abd7dd9be464eb98613d9489411b2` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:10.534596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=594abd7dd9be464eb98613d9489411b2)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:10.536530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:10.718929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594abd7dd9be464eb98613d9489411b2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.725675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594abd7dd9be464eb98613d9489411b2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.737640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594abd7dd9be464eb98613d9489411b2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.738347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594abd7dd9be464eb98613d9489411b2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.742711 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0c735b6a-0758-4f7a-b440-b7fa97af7fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594abd7dd9be464eb98613d9489411b2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:10.825288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1209/2417] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:20:10 2022] DELETE /identity/v3/users/594abd7dd9be464eb98613d9489411b2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:11.089236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.090698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:11.104765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5a2a-07e5-49fc-a318-271258bb0b59 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.162692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.169700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.169700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.169700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] PATH_INFO: `/v3/projects/142c956789bc4a4d911af0a0862776a7` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.169700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142c956789bc4a4d911af0a0862776a7)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.169700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:11.300121 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142c956789bc4a4d911af0a0862776a7', 'request_id': 'req-957c31df-803e-4ee4-a134-0a016db60647'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:11.306542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142c956789bc4a4d911af0a0862776a7', 'request_id': 'req-957c31df-803e-4ee4-a134-0a016db60647'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:11.312399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142c956789bc4a4d911af0a0862776a7', 'request_id': 'req-957c31df-803e-4ee4-a134-0a016db60647'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:11.402213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] The token cache is being invalidate because project 142c956789bc4a4d911af0a0862776a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:20:11.402454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:11.403118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-957c31df-803e-4ee4-a134-0a016db60647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:20:11.404766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1209/2418] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:20:11 2022] DELETE /identity/v3/projects/142c956789bc4a4d911af0a0862776a7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:11.411187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.411569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.411958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.430593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:11.431782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:11.494550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1210/2419] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:11.504454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.504748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.505035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.524417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:11.525621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:11.534757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1210/2420] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:11.539141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.548835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c33514-9405-4a42-9bfc-fc8a8c85388b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.553376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.554027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.554308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.554585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.555304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:20:11.555612 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.557236 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:11.568516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1211/2421] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:20:11.572874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.582740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c37df5-4b8d-47e8-8376-2d220dacc418 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.588089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.588737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.589022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.589299 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.589996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.591951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:11.706680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1211/2422] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:20:11 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:20:11.710879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.721629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91aedc5-7564-4275-a650-6b15010e72a3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.776873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.777541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.777826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.778105 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.778837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.780861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:11.887760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1212/2423] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:20:11 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:20:11.892128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.904073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de71f-7e91-4fab-80ca-320052babdff admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.909115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.909774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.910185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.910468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.911207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.912859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:11.925589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1212/2424] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:20:11.929775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.940557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e24c9b-0cbc-424d-96d4-47a1782aabd4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.945393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caa96b-186c-4f45-8546-9abaf2b14efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.946050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa96b-186c-4f45-8546-9abaf2b14efb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.946349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa96b-186c-4f45-8546-9abaf2b14efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.946607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caa96b-186c-4f45-8546-9abaf2b14efb admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.947332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa96b-186c-4f45-8546-9abaf2b14efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.949052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77caa96b-186c-4f45-8546-9abaf2b14efb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:11.959964 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1213/2425] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:20:11.964075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:11.974724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fe072-8ced-49d1-9e14-8ad99ca624c2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:11.979912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:11.980870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:11.981155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:11.981436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] PATH_INFO: `/v3/projects/7893fdef34394d6ba4de0526f89244ac/users/3b98d22b274f4e5e8f4ea3548534a821/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:11.996882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7893fdef34394d6ba4de0526f89244ac, user_id=3b98d22b274f4e5e8f4ea3548534a821, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:11.999552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.083582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1213/2426] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:20:11 2022] PUT /identity/v3/projects/7893fdef34394d6ba4de0526f89244ac/users/3b98d22b274f4e5e8f4ea3548534a821/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:12.093741 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.097888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.097888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.121700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] MFA Rules not processed for user `3b98d22b274f4e5e8f4ea3548534a821`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:12.122941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:12.196085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1214/2427] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:12.200624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:12.267960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57918-e522-4dc2-a686-4ec4ce8463b0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:12.272750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:12.273654 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.273941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.274220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.274918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:12.276887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.386329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1214/2428] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:20:12 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:20:12.390667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:12.402590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9970c-202d-45da-93bf-aa3ac3fbfb8f None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:12.459235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:12.459972 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.460265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.460543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.461248 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:12.463147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.539092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1215/2429] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:20:12 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:20:12.542764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:12.553350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea6f60-0baf-4299-a9f0-0c745c43ab96 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:12.558148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:12.558807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.559090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.559368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.560135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:12.561795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.572355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1215/2430] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:20:12.576599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:12.587197 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b10d-4c76-48b8-a93a-1efa5204c73f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:12.591780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:12.592679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.592963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.593239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] PATH_INFO: `/v3/projects/149022b161f04c09973b61b865948981/users/23aa0faced4e4e308d4bf3342c61572d/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.608256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=149022b161f04c09973b61b865948981, user_id=23aa0faced4e4e308d4bf3342c61572d, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:12.610903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.687879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1216/2431] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:20:12 2022] PUT /identity/v3/projects/149022b161f04c09973b61b865948981/users/23aa0faced4e4e308d4bf3342c61572d/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:20:12.693118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:12.703354 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7b23e-24de-40f4-84ed-40af43a479ad admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:12.758031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8a355-76a7-4d77-986d-6f54401189ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:12.758694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a355-76a7-4d77-986d-6f54401189ba admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.758977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a355-76a7-4d77-986d-6f54401189ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.759254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8a355-76a7-4d77-986d-6f54401189ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.760006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8a355-76a7-4d77-986d-6f54401189ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:12.761614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8a355-76a7-4d77-986d-6f54401189ba admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.771748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1216/2432] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:20:12.778106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:12.788795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647adce7-fef7-4bb2-836d-434feccf03cd admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:12.793677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:12.794497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.794795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.795114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] PATH_INFO: `/v3/projects/149022b161f04c09973b61b865948981/users/23aa0faced4e4e308d4bf3342c61572d/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.798206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149022b161f04c09973b61b865948981, user_id=23aa0faced4e4e308d4bf3342c61572d, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:12.801225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:12.812123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1217/2433] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:20:12 2022] PUT /identity/v3/projects/149022b161f04c09973b61b865948981/users/23aa0faced4e4e308d4bf3342c61572d/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:20:12.824960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:12.825206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:12.825487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:12.854288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] MFA Rules not processed for user `23aa0faced4e4e308d4bf3342c61572d`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:20:12.855526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:12.923003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1217/2434] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:20:21.373385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:20:21.375166 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:21.437953 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e5eb-431a-4b2a-96e3-871b70994008 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:20:21.441657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:20:21.442303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:20:21.442582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:20:21.442862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:20:21.444869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:20:21.454214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:20:21.455616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:20:21.464003 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1218/2435] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:20:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:21:03.073576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:21:03.073576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:21:03.082371 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:21:03.083930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:21:03.133233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddea12-8cbf-47f6-9ac1-c0358fdb44f9 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:21:03.137628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:21:03.138348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:21:03.138640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:21:03.139027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:21:03.148787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:21:03.150942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:21:03.159639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403dd140-a127-48f3-ba9e-62cf9eab4da7 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:21:03.163945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1218/2436] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:21:03.166541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:21:03.167196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:21:03.167498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:21:03.167776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:21:03.169767 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:21:03.249435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:21:03.251031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:21:03.269307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1219/2437] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:21:03.375971 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:21:03.388955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184519-8f56-4717-9148-3f967902d7d2 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:21:03.394589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:21:03.395213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:21:03.395497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:21:03.395776 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:21:03.397844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:21:03.476352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:21:03.477990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:21:03.496160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1219/2438] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:21:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:22:02.133415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:22:02.134314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:22:02.174557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab0e8c-a03e-4cb6-a641-9a2801379e3f service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:22:02.178258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:22:02.178896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:22:02.179822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:22:02.180373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:22:02.182283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:22:02.272345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:22:02.274564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:22:02.292837 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1220/2439] 10.222.0.91 () {60 vars in 1396 bytes} [Mon Feb 21 01:22:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:22:02.416878 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:22:02.436598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823ac8-6ebc-411f-8fc2-3ea0bd696369 service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:22:02.450385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:22:02.450385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:22:02.450385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:22:02.450385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:22:02.450779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:22:02.522188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:22:02.524249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:22:02.542239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1220/2440] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:22:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:22:20.656683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:22:20.658067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:22:20.749651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb4327-022c-4d7b-a784-d8deb146fb63 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:22:20.754668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:22:20.755300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:22:20.755584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:22:20.755885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:22:20.758242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:22:20.769173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:22:20.770986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:22:20.781138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1221/2441] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:23:03.382800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:23:03.391524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f24093-c11c-47ba-bb60-7c1cf136266a service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:23:03.397151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:23:03.397786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:23:03.398069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:23:03.398353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:23:03.459498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:23:03.461000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:23:03.470075 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1221/2442] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:02.031383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:02.040495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4312299-c350-48f0-a3ad-2f6f5369a064 service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:02.044713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:02.045328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:02.045608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:02.045882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:02.047603 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:25:02.119295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:02.120745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:02.129655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1222/2443] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:25:25.374574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:25:25.395352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd977a2-1a34-469e-9ec8-e99cb5b66ab1 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:25:25.399304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:25:25.400012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:25:25.400364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:25:25.400714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:25:25.408496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:25:25.409973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:25:25.418608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1222/2444] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:25:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:26:02.544947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:02.563338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f083bc9-991c-4f05-bdc6-cf9f8e98b487 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:02.567032 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:02.567665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:02.567982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:02.568261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:02.577109 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:02.578519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:02.587334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1223/2445] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:26:02.770140 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:26:02.779340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66908d58-77e0-439a-b593-d0c38ebd3ae8 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:26:02.782938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:26:02.783558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:26:02.783862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:26:02.784147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:26:02.792618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:26:02.794066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:26:02.803622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1223/2446] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:26:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:03.181273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:03.188999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae4280-13c5-4315-87f1-e695cd72b94a service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:03.193463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:03.194082 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:03.194363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:03.194638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:03.202788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:03.204222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:03.212926 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1224/2447] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:03.296946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:03.308049 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57150f7b-7415-4133-8cc6-9c27f20dbc9b service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:03.311760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:03.312425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:03.312706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:03.312982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:03.332607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:03.334040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:03.346652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1224/2448] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:27:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:27:26.622524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:27:26.635608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89505e54-2d4b-436b-803d-b37f15c470c7 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:27:26.641448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180884b-12e1-4b10-bf2a-9110c9337cfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:27:26.642077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180884b-12e1-4b10-bf2a-9110c9337cfa service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:27:26.642356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180884b-12e1-4b10-bf2a-9110c9337cfa service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:27:26.642629 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180884b-12e1-4b10-bf2a-9110c9337cfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:27:26.651660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180884b-12e1-4b10-bf2a-9110c9337cfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:27:26.653444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180884b-12e1-4b10-bf2a-9110c9337cfa service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:27:26.672357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1225/2449] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:02.901822 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:02.903249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:02.997811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eaf80-8e8e-4383-9b7d-c3fb92ff3c76 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:03.002199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:03.003147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:03.003597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:03.003904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] PATH_INFO: `/v3/users/569bed6ed79c4896a66f52f0b5875f3c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:03.005082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=569bed6ed79c4896a66f52f0b5875f3c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:03.007267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:03.214543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569bed6ed79c4896a66f52f0b5875f3c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:03.215213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569bed6ed79c4896a66f52f0b5875f3c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:03.222430 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569bed6ed79c4896a66f52f0b5875f3c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:03.233597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569bed6ed79c4896a66f52f0b5875f3c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:03.234300 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569bed6ed79c4896a66f52f0b5875f3c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:03.292166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1225/2450] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:28:02 2022] DELETE /identity/v3/users/569bed6ed79c4896a66f52f0b5875f3c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:03.296518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:03.299436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:03.299436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:03.322347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:03.323524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:03.382943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1226/2451] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:03.392623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:03.394549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:03.463256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c0f1-957e-4ee9-8638-07196fda7f9c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:03.466923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:03.467561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:03.467860 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:03.468157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:03.478362 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:03.479785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:03.489135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1226/2452] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:03.793946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:03.797316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:03.867322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dce244-4ecd-493d-9fb2-052c16d1e3b9 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:03.869742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:03.870230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:03.870436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:03.870681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:03.870960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:03.871983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:03.872935 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:03.885535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb63363-df7d-4fd5-8c67-42f139a1016c service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:03.890594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:03.891630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:03.892115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:03.892730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] PATH_INFO: `/v3/projects/6014d3ab6c2340118e3169042219b569` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:03.894579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6014d3ab6c2340118e3169042219b569)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:03.896697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:03.938227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:03.941748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96d268-3362-4d6d-b069-30ba2e2bbeeb service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:03.948957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1227/2453] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:04.029918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6014d3ab6c2340118e3169042219b569', 'request_id': 'req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:04.036645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6014d3ab6c2340118e3169042219b569', 'request_id': 'req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:04.042363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6014d3ab6c2340118e3169042219b569', 'request_id': 'req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:04.132519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] The token cache is being invalidate because project 6014d3ab6c2340118e3169042219b569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:28:04.132805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:04.133431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-3e8f920f-7e6b-4c8f-ada6-48c5d3b5b59d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:28:04.134967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1227/2454] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:28:03 2022] DELETE /identity/v3/projects/6014d3ab6c2340118e3169042219b569 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:04.141019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.141325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.141633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.190136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:04.191499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:04.246186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1228/2455] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:04.254316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.254611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.254897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.274536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:04.275750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:04.284399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1228/2456] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:04.288100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.297706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d8c49-86ba-4735-9d4e-d28678659b56 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.302541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.303187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.303474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.303758 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.304535 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:28:04.304850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.306431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.318180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1229/2457] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:28:04.322230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.331955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223443e-fb07-41d9-a9d8-37e6759eb900 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.336786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.337421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.337703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.337977 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.338666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.340595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.414324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1229/2458] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:28:04 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:28:04.418464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.429039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2a5b5-0875-486a-a51a-062a1cb1e3c7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.483119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.483785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.484102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.484380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.485075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.486956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.578198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1230/2459] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:28:04 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:28:04.583624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.593961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b1760-993a-4080-98e9-4415da924245 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.599257 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.599941 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.600232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.600515 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.601239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.602834 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.613979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1230/2460] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:28:04.617761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.627556 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca3cbd-d497-4517-a553-01f3fa956aef admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.633120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807867c-d91c-4733-b056-cadadca0d86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.633787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807867c-d91c-4733-b056-cadadca0d86f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.634071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807867c-d91c-4733-b056-cadadca0d86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.634348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807867c-d91c-4733-b056-cadadca0d86f admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.635059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807867c-d91c-4733-b056-cadadca0d86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.636662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807867c-d91c-4733-b056-cadadca0d86f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.646272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1231/2461] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:28:04.650091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.659826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057982e8-a15e-47ac-b39e-7185e91dcffb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.664477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.665274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.665555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.665836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] PATH_INFO: `/v3/projects/8b8129cff1a0403ea1c6790469938a6e/users/6f1e29b663e842c4a8046fafcd20f151/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.680067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8129cff1a0403ea1c6790469938a6e, user_id=6f1e29b663e842c4a8046fafcd20f151, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.682680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.755532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1231/2462] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:28:04 2022] PUT /identity/v3/projects/8b8129cff1a0403ea1c6790469938a6e/users/6f1e29b663e842c4a8046fafcd20f151/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:28:04.760857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972046e-d899-4324-b575-4535201ff5c2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.761155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972046e-d899-4324-b575-4535201ff5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.761443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972046e-d899-4324-b575-4535201ff5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.781304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5972046e-d899-4324-b575-4535201ff5c2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:04.782595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5972046e-d899-4324-b575-4535201ff5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:04.839933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1232/2463] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:04.849572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:04.851282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:04.907498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c8f4-1f1b-4e9c-a14a-f0fe34d09eaa admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:04.911571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:04.912244 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:04.912524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:04.912801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:04.922011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:04.923437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:04.933504 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1232/2464] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:10.114605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.115193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.115193 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.150276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] MFA Rules not processed for user `6f1e29b663e842c4a8046fafcd20f151`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:10.151558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:10.240917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1233/2465] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:10.245209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:10.256922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a652c-ba9a-4556-a62b-ea7a29fabbec service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:10.261626 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:10.262273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.262564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.263017 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.263649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:10.265584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:10.353838 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1233/2466] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:28:10 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:28:10.355567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:10.370614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f350d5b-0d43-4438-8366-fdb5cc61c019 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:10.438096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:10.438763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.439047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.439344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.440071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:10.442732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:10.544356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1234/2467] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:28:10 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:28:10.548824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:10.559580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9b0fd-6cf3-4c85-a670-ba2b1c23e407 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:10.569202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:10.569202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.569202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.569202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.569904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:10.569904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:10.580497 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1234/2468] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:28:10.585395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:10.595459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b752-286d-4978-8e6f-750329162694 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:10.600216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:10.601087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.601366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.601642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] PATH_INFO: `/v3/projects/0e4f1d5ebee4448fa8ec3b03374d8293/users/8f62d0704940466e8e578bf742de69d2/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.616443 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4f1d5ebee4448fa8ec3b03374d8293, user_id=8f62d0704940466e8e578bf742de69d2, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:10.619050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:10.750015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1235/2469] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:28:10 2022] PUT /identity/v3/projects/0e4f1d5ebee4448fa8ec3b03374d8293/users/8f62d0704940466e8e578bf742de69d2/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:28:10.754392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:10.764411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e0a5-d9c8-45c7-852b-d9231aee5bc8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:10.820671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bf6a9-e31f-43d3-8d39-e605f46e5fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:10.821498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bf6a9-e31f-43d3-8d39-e605f46e5fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.821785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bf6a9-e31f-43d3-8d39-e605f46e5fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.822066 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bf6a9-e31f-43d3-8d39-e605f46e5fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.822799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bf6a9-e31f-43d3-8d39-e605f46e5fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:10.824445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bf6a9-e31f-43d3-8d39-e605f46e5fb5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:10.835001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1235/2470] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:28:10.839224 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:10.849548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1657641-a1c4-48ab-bc38-c45305f4a3c0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:10.854187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:10.855047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:10.855326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:10.855601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] PATH_INFO: `/v3/projects/0e4f1d5ebee4448fa8ec3b03374d8293/users/8f62d0704940466e8e578bf742de69d2/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:10.857564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4f1d5ebee4448fa8ec3b03374d8293, user_id=8f62d0704940466e8e578bf742de69d2, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:10.860209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:10.873534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1236/2471] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:28:10 2022] PUT /identity/v3/projects/0e4f1d5ebee4448fa8ec3b03374d8293/users/8f62d0704940466e8e578bf742de69d2/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:28:16.542411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654685fb-077d-4b23-8fbd-9131a076c002 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:16.542938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654685fb-077d-4b23-8fbd-9131a076c002 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:16.543036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654685fb-077d-4b23-8fbd-9131a076c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:16.573282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-654685fb-077d-4b23-8fbd-9131a076c002 None None] MFA Rules not processed for user `8f62d0704940466e8e578bf742de69d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:16.574534 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-654685fb-077d-4b23-8fbd-9131a076c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:16.650164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1236/2472] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:28:16.663277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:28:16.665036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:16.772293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d391224-17b2-455d-a9e9-a87a06f15454 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:28:16.781674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:28:16.782335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:16.782620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:16.782897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:16.841489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:28:16.843093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:28:16.853462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1237/2473] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:28:19.651442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:28:19.652073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:28:19.652073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:28:19.674056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] MFA Rules not processed for user `6f1e29b663e842c4a8046fafcd20f151`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:28:19.676258 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:28:19.684995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1237/2474] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:30:01.799623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:01.801084 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.856493 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e6ae1-af01-4cf0-8e44-ac7d98561717 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:01.860075 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:01.860710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:01.860995 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:01.861272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:01.863028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:01.919367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:01.920768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:01.929490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1238/2475] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:04.305408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:04.306861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:04.362738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9d45e-0581-4578-836d-6a292502af66 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:04.366412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:04.367083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:04.368203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:04.368472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:04.370328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:04.386013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:04.387520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:04.399629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1238/2476] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:06.498299 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:06.508997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53210043-f9d6-4a65-8bf7-62f58ba262b4 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:06.512655 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:06.513313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:06.513598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:06.513873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:06.515652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:06.583204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:06.583204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:06.589311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1239/2477] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:07.943222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:07.952403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5a0a7-e8c8-42c3-8bf4-0934ddebedd0 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:07.956571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:07.957215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:07.957496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:07.957773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:07.959652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:07.981088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:07.982351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:07.995674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1239/2478] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:30:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:30:14.708488 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:14.710628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:14.724512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de226468-5d78-412b-bfcd-49b0567bf274 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:14.729480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:14.730343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:14.730632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:14.730914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] PATH_INFO: `/v3/users/6f525569d9ed4d61926ddad83a270032` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:14.732155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f525569d9ed4d61926ddad83a270032)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:14.737131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:14.904873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f525569d9ed4d61926ddad83a270032'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:14.912763 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f525569d9ed4d61926ddad83a270032'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:14.925883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f525569d9ed4d61926ddad83a270032'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:14.926599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f525569d9ed4d61926ddad83a270032'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:14.927223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f525569d9ed4d61926ddad83a270032'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:14.981220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1240/2479] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:30:14 2022] DELETE /identity/v3/users/6f525569d9ed4d61926ddad83a270032 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:30:15.206581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:15.217441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db946b-387d-4839-8433-551cd44c5e76 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:15.277923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:15.278775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:15.279059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:15.279331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] PATH_INFO: `/v3/projects/0c96b1f3aaed4700a792cf9d25aaaca3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:15.280551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c96b1f3aaed4700a792cf9d25aaaca3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:15.283100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:15.394440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c96b1f3aaed4700a792cf9d25aaaca3', 'request_id': 'req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.400585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c96b1f3aaed4700a792cf9d25aaaca3', 'request_id': 'req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.406298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c96b1f3aaed4700a792cf9d25aaaca3', 'request_id': 'req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.473168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] The token cache is being invalidate because project 0c96b1f3aaed4700a792cf9d25aaaca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:30:15.473465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.474098 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.475645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1240/2480] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:30:15 2022] DELETE /identity/v3/projects/0c96b1f3aaed4700a792cf9d25aaaca3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:30:15.479730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:15.484401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:15.495111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61706507-dd62-4a97-9da8-6c6b0caada99 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:15.562950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:15.564753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:15.565156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:15.565441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] PATH_INFO: `/v3/users/f9f87c6237d644b0b1c2232078a1dd91` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:15.583301 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f87c6237d644b0b1c2232078a1dd91)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:15.586540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:15.766672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f87c6237d644b0b1c2232078a1dd91'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.775179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f87c6237d644b0b1c2232078a1dd91'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.787126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f87c6237d644b0b1c2232078a1dd91'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.787880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f87c6237d644b0b1c2232078a1dd91'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.791149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f87c6237d644b0b1c2232078a1dd91'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:15.879333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1241/2481] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:30:15 2022] DELETE /identity/v3/users/f9f87c6237d644b0b1c2232078a1dd91 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:30:16.133413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:30:16.134993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:30:16.148485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8799f9-33a6-4ab1-aac6-b9ac57e83755 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:30:16.207807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:30:16.208692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:30:16.208980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:30:16.209263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] PATH_INFO: `/v3/projects/ae80b3a710c845deaebd80650162c77a` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:30:16.220365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae80b3a710c845deaebd80650162c77a)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:30:16.223041 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:30:16.353446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae80b3a710c845deaebd80650162c77a', 'request_id': 'req-35628d32-b1c7-404c-bccc-136cccb41b80'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:16.360961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae80b3a710c845deaebd80650162c77a', 'request_id': 'req-35628d32-b1c7-404c-bccc-136cccb41b80'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:16.366328 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae80b3a710c845deaebd80650162c77a', 'request_id': 'req-35628d32-b1c7-404c-bccc-136cccb41b80'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:16.427293 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] The token cache is being invalidate because project ae80b3a710c845deaebd80650162c77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:30:16.427611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:16.428239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:30:16.429887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1241/2482] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:30:16 2022] DELETE /identity/v3/projects/ae80b3a710c845deaebd80650162c77a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:31:02.287798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:02.289885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:02.349820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e4d97-9cca-4175-bead-b7e6f60f6df1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:02.399009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:02.399658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:02.399989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:02.400274 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:02.402057 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:02.461677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:02.463092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f415f51-8353-4e7c-998c-792521e81344 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:02.472674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1242/2483] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:31:32.349279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:31:32.350762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:32.408647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35628d32-b1c7-404c-bccc-136cccb41b80 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:31:32.412348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:31:32.413019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:31:32.413307 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:31:32.413589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:31:32.415369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:31:32.424965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:31:32.426395 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:31:32.434190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1242/2484] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:31:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:01.721779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:01.722235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:01.722340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:01.778130 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:01.779317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:01.843187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1243/2485] 10.222.0.91 () {58 vars in 967 bytes} [Mon Feb 21 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:01.998690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:02.000236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:02.089245 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367772a2-9296-4620-b28a-08b16caf308f service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:02.095255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:02.099687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:02.099687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:02.099687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:02.105724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:02.107420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:02.116689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1243/2486] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:32:04.003863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:04.005521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:04.124868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e7d50-1d9e-4571-8d08-83eaa4f2ac3b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:04.131155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:04.131808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:04.132134 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:04.132461 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:04.134180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:04.146698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:04.148317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56424fa-cd6a-4082-b688-f2dded5da640 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:04.159207 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1244/2487] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:04.401761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:04.427769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62574-63ec-4e2b-adf3-22c0d49560b3 None None] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:04.428090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62574-63ec-4e2b-adf3-22c0d49560b3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:04.428572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62574-63ec-4e2b-adf3-22c0d49560b3 None None] PATH_INFO: `/` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:04.430348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1245/2488] 10.222.0.91 () {54 vars in 912 bytes} [Mon Feb 21 01:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 01:32:04.436070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:04.436358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:04.436646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:04.449872 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723e495-0fc0-412a-95ec-e1938956c209 service swift] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:04.456686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:04.457591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:04.458179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:04.458691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:04.460784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:04.477659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] MFA Rules not processed for user `6e9442e0d7974df3984122cad45a0320`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:04.479356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:04.548631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:04.548859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1246/2489] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:32:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:32:04.550978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e917896-76de-4fe0-af42-32b05fa54364 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:04.572197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1244/2490] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:04.572933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:04.574336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:04.587895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bac7-dd5d-40c3-95f4-67b6798eb5fb None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:04.593181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:04.593829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:04.594115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:04.594523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:04.604708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:04.606307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:04.616779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1247/2491] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:32:08.482394 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.486043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.486043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.531358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] MFA Rules not processed for user `5adf4837cc254e1a951dda183d795606`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:32:08.532541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:08.548538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1245/2492] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:32:08.855460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:08.857038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:08.869157 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248d414-5163-422d-be8d-2fa86436c699 service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:08.872975 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:08.873594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:08.873878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:08.874155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:08.875913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:08.885689 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:08.887094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:08.895356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1248/2493] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:09.285681 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:09.287248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:09.302130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82439b9-b99f-45ee-be38-4778d5686cd0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:09.307228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:09.308035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:09.308322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:09.308599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:09.310439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:09.323194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:09.324795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:09.335326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1246/2494] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:18.838310 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:18.844643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:18.856878 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b966a-352e-46f7-819c-c9fa049954d1 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:18.871739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:18.871739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:18.871739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:18.871739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:18.872225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:18.878910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:18.880533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:18.891714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1249/2495] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:22.586373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:22.606819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729081ec-5313-48fe-8339-f442cce746f9 service placement] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:22.612616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:22.613335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:22.613682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:22.614027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:22.616006 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:22.628947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:22.630608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:22.641787 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1247/2496] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:32:33.639167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:32:33.666668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e3e5-f10e-43fd-bb89-626f260d659a service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:32:33.671639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:32:33.672312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:32:33.672595 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:32:33.672867 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:32:33.674996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:32:33.697318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:32:33.698852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:32:33.708971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1250/2497] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:04.703223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:04.705310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:04.716310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f10b7-1639-40f0-84c3-ee9ecebfc2fe service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:04.720754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:04.721491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:04.721782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:04.722059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:04.730213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:04.808652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:04.810085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:04.829583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1248/2498] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:33:17.668179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:33:17.678284 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce04b5-e415-4ecc-a97b-aacf3a7c6eff service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:33:17.681981 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:33:17.682613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:33:17.682899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:33:17.683177 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:33:17.684990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:33:17.742042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:33:17.743464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:33:17.752728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1251/2499] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:33:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:22.040986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:22.050848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814cefd-4340-4f53-b279-d5f61de7ab9d service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:22.054465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:22.055095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:22.055380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:22.055660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:22.057450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:22.119636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:22.121108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:22.131514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1249/2500] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:34:30.176810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:30.178713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:30.201987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9322ad-e01a-45f2-b8ef-b721635234e3 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:30.210671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:30.211553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:30.211864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:30.212143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] PATH_INFO: `/v3/users/6f1e29b663e842c4a8046fafcd20f151` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:30.213407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1e29b663e842c4a8046fafcd20f151)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:30.215551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:30.348646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1e29b663e842c4a8046fafcd20f151'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.355377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1e29b663e842c4a8046fafcd20f151'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.367536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1e29b663e842c4a8046fafcd20f151'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.368251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1e29b663e842c4a8046fafcd20f151'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.368851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1e29b663e842c4a8046fafcd20f151'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.426895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1252/2501] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:30 2022] DELETE /identity/v3/users/6f1e29b663e842c4a8046fafcd20f151 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:30.671579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:30.683336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea5cf-9992-41eb-b7dd-051eaf4bbd17 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:30.739044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:30.739951 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:30.740240 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:30.740521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] PATH_INFO: `/v3/projects/8b8129cff1a0403ea1c6790469938a6e` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:30.741946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8129cff1a0403ea1c6790469938a6e)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:30.743857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:30.866150 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8129cff1a0403ea1c6790469938a6e', 'request_id': 'req-e72eb294-a314-4e4f-9710-3cc2d411f43c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.872473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8129cff1a0403ea1c6790469938a6e', 'request_id': 'req-e72eb294-a314-4e4f-9710-3cc2d411f43c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.878374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8129cff1a0403ea1c6790469938a6e', 'request_id': 'req-e72eb294-a314-4e4f-9710-3cc2d411f43c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.950849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] The token cache is being invalidate because project 8b8129cff1a0403ea1c6790469938a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:30.951070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.951711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:30.953432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1250/2502] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:30 2022] DELETE /identity/v3/projects/8b8129cff1a0403ea1c6790469938a6e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:30.958428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:30.959890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:30.973467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152f5d-43b0-4591-8ffc-c37cf81a5fc0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:31.028233 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:31.029089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:31.029368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:31.029643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] PATH_INFO: `/v3/users/8f62d0704940466e8e578bf742de69d2` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:31.030809 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f62d0704940466e8e578bf742de69d2)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:31.032771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:31.215740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f62d0704940466e8e578bf742de69d2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.223309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f62d0704940466e8e578bf742de69d2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.236604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f62d0704940466e8e578bf742de69d2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.237358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f62d0704940466e8e578bf742de69d2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.238153 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f62d0704940466e8e578bf742de69d2'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.309936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1253/2503] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:34:30 2022] DELETE /identity/v3/users/8f62d0704940466e8e578bf742de69d2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:34:31.536913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:34:31.538399 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:34:31.553726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb294-a314-4e4f-9710-3cc2d411f43c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:34:31.610640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:34:31.611750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:34:31.612068 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:34:31.612347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] PATH_INFO: `/v3/projects/0e4f1d5ebee4448fa8ec3b03374d8293` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:34:31.613542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4f1d5ebee4448fa8ec3b03374d8293)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:34:31.615443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:34:31.712440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4f1d5ebee4448fa8ec3b03374d8293', 'request_id': 'req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.718608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4f1d5ebee4448fa8ec3b03374d8293', 'request_id': 'req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.725287 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4f1d5ebee4448fa8ec3b03374d8293', 'request_id': 'req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.789427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] The token cache is being invalidate because project 0e4f1d5ebee4448fa8ec3b03374d8293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:34:31.789657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.790277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:34:31.791792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1251/2504] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:34:31 2022] DELETE /identity/v3/projects/0e4f1d5ebee4448fa8ec3b03374d8293 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:35:02.189743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:02.191947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:02.248517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de66b-e7fd-43be-9f90-9b92c9af70ed admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:02.295187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:02.295875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:02.296167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:02.296447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:02.298232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:02.375581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:02.377050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:02.394471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1254/2505] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:05.133292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:05.134796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:05.189267 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dba5a-db72-466a-a4bd-720bd9d5d4a3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:05.193203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:05.193833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:05.194117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:05.194393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:05.196179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:05.264532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:05.265972 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:05.277319 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1252/2506] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:35:09.741364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:35:09.742827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:09.753991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007cd49-99e9-4b2f-a6ba-e070a7d03369 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:35:09.757730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:35:09.758366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:35:09.758652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:35:09.758928 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:35:09.760659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:35:09.774470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:35:09.775934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:35:09.787178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1255/2507] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:35:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:02.917422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:02.918904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:02.939129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa37892-046c-4932-ac7d-bb2c787805cc service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:02.942813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:02.943441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:02.943727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:02.944039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:02.945750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:03.003916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:03.005339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:03.014114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1253/2508] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:06.421282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:06.426676 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31cd8-035e-4179-9b1c-091ca1f46cef service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:06.430363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:06.431024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:06.431360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:06.431678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:06.433521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:06.515915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:06.517436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:06.535452 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1256/2509] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:36:37.345996 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:36:37.365653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765fdcc-354d-4261-938e-61aa270c38ac service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:36:37.369348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:36:37.369982 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:36:37.370270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:36:37.370552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:36:37.372376 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:36:37.382220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:36:37.383643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:36:37.391483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1254/2510] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:37:03.683913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:03.685337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:03.701008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8395ac-d79a-4ac8-9947-bdf253c091ca service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:03.707337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:03.708017 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:03.708302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:03.708576 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:03.710388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:03.722652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:03.727632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:03.735699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1257/2511] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:05.576414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:05.586514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ca76-e7d3-4692-b16b-4c93d5af90a9 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:05.590165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:05.590799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:05.591084 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:05.591366 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:05.593185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:05.652193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:05.653630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:05.663016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1255/2512] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:37:41.619122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:37:41.620565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:41.686547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539da61b-b430-4c15-9433-db12e6a2731c service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:37:41.692348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:37:41.692987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:37:41.693292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:37:41.693557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:37:41.695365 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:37:41.706581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:37:41.708172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:37:41.717727 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1258/2513] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:37:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:39:06.221693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:39:06.230297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5b31e-2761-4ea2-a985-16a3c536897a service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:39:06.233961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:39:06.234585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:39:06.234875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:39:06.235357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:39:06.237135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:39:06.293162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:39:06.294511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:39:06.303234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1256/2514] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:39:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:03.120136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:03.121627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:40:03.164922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3114cc-0187-4abd-8153-9be216faddf2 service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:03.170539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:03.171179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:03.171464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:03.171742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:03.179806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:03.181393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:03.190789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1259/2515] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:06.673097 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:06.682671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9f3f3-0d1d-43c0-b44f-b019b8509438 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:06.686387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:06.687015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:06.687297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:06.687575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:06.698217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:06.699619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:06.710241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1257/2516] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:40:09.997415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:40:10.007189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9004180-4b41-4fe7-8f13-303003c5bd44 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:40:10.010782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:40:10.011403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:40:10.011684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:40:10.012006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:40:10.022602 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:40:10.024039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:40:10.034584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1260/2517] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:40:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:41:06.530462 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:41:06.532647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:41:06.567189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d2fb9-50be-426b-9773-f91c5caff059 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:41:06.567189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:41:06.567796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:41:06.568167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:41:06.568512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:41:06.577251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:41:06.579225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:41:06.592363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1258/2518] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:42:48.579007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:42:48.635463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeac193-d032-496c-bbb0-4237ee1e942d service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:42:48.640600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:42:48.642016 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:42:48.642362 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:42:48.642650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:42:48.651732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:42:48.653323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:42:48.664555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1261/2519] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:42:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:05.203661 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:05.223074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ed6c-e6bc-4958-bb0b-2e4b0c9c5cf8 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:05.226689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:05.227322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:05.227608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:05.227927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:05.229704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:05.322038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:05.323398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:05.341726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1259/2520] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:06.692249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:06.700185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407de0b-5d25-4f30-a765-134248a83b6d service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:06.704138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:06.704768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:06.705045 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:06.705325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:06.714111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:06.715517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:06.746113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1262/2521] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:08.407698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:08.409586 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:08.424164 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cafc0f-ab14-4b56-941b-def4040bdbf8 service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:08.429194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:08.430186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:08.430578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:08.430936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] PATH_INFO: `/v3/users/8287f43e83034c0a80ee051456d502c6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:08.432209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8287f43e83034c0a80ee051456d502c6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:08.434206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:08.587057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8287f43e83034c0a80ee051456d502c6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:08.587650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8287f43e83034c0a80ee051456d502c6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:08.594670 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8287f43e83034c0a80ee051456d502c6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:08.606055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8287f43e83034c0a80ee051456d502c6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:08.606765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-601784cf-ba4e-4155-96ac-ecf5c783375d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8287f43e83034c0a80ee051456d502c6'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:08.716321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1260/2522] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:08 2022] DELETE /identity/v3/users/8287f43e83034c0a80ee051456d502c6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:08.967393 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:08.976902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8448567-3436-44bb-be17-e3d14b7749f7 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.034822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.035678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.035997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.036281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] PATH_INFO: `/v3/projects/a5cb0164f98741baba94fcc1b7709e7e` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.037480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cb0164f98741baba94fcc1b7709e7e)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.039383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.201869 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cb0164f98741baba94fcc1b7709e7e', 'request_id': 'req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:09.207072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cb0164f98741baba94fcc1b7709e7e', 'request_id': 'req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:09.270665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cb0164f98741baba94fcc1b7709e7e', 'request_id': 'req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:09.282571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] The token cache is being invalidate because project a5cb0164f98741baba94fcc1b7709e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:09.282844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:09.283478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3b5b1aa9-963b-4d26-9c1c-85692ef02c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:09.285058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1263/2523] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:08 2022] DELETE /identity/v3/projects/a5cb0164f98741baba94fcc1b7709e7e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:09.290890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.291204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.291494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.349009 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:09.350234 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:09.408864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1261/2524] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:09.416942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.417240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.417519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.435690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:09.436976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:09.444970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1264/2525] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:09.449215 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:09.459309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa44966-6f90-4db5-bbae-3eb99626f6e7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.464004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.464640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.465040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.465283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.466004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:09.466304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.467906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.480170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1262/2526] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:43:09.484586 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:09.494456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610df89-9ddf-4f20-b358-2c5f2dc6aec3 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.499114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.499787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.500103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.500386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.501678 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.503598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.620550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1265/2527] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:09 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:09.624518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:09.634677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0ce03-db15-4897-8bd2-7d61637ca90d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.691291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.691984 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.692274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.692556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.693246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.695154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.780072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1263/2528] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:09 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:09.784163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:09.794738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67515655-f5fb-4207-ae74-595778d11b26 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.799507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.800195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.800485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.800761 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.801487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.803067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.812682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1266/2529] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:09.817352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:09.827544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3e409-e3d7-404e-b876-0541aff2ec19 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.833132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133c2f0-8245-4be4-942e-e062637ecce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.833812 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c2f0-8245-4be4-942e-e062637ecce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.834099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c2f0-8245-4be4-942e-e062637ecce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.834377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133c2f0-8245-4be4-942e-e062637ecce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.835103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133c2f0-8245-4be4-942e-e062637ecce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.836725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133c2f0-8245-4be4-942e-e062637ecce1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.847013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1264/2530] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:09.851143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:09.860936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc48f-af0a-4cc7-899f-435659c2a9eb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:09.865561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:09.866415 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.866696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.866970 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] PATH_INFO: `/v3/projects/40d1276aa84a48ab830165304f9d6f74/users/7ae637d5f7f941d8b3b3264c786faddc/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.881598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d1276aa84a48ab830165304f9d6f74, user_id=7ae637d5f7f941d8b3b3264c786faddc, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:09.884267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:09.939144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1267/2531] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:09 2022] PUT /identity/v3/projects/40d1276aa84a48ab830165304f9d6f74/users/7ae637d5f7f941d8b3b3264c786faddc/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:09.944186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:09.944478 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:09.944760 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:09.962836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:09.967768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:10.021158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1265/2532] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:10.030725 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:10.032465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:10.100192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761dc5a-f5fa-4274-8596-cc145369a5b5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:10.103931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee4ee2-0581-42f7-b7cb-973c1e2b7408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:10.104571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4ee2-0581-42f7-b7cb-973c1e2b7408 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:10.104856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4ee2-0581-42f7-b7cb-973c1e2b7408 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:10.105135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee4ee2-0581-42f7-b7cb-973c1e2b7408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:10.114677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4ee2-0581-42f7-b7cb-973c1e2b7408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:10.116176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee4ee2-0581-42f7-b7cb-973c1e2b7408 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:10.125433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1268/2533] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:12.705004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:12.710435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.834471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df69cd-d8fe-46d7-8534-ca89340b6a74 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:12.849512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:12.851976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.851976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.853166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.861869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:12.871456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:12.872044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:12.872210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:12.883718 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: WARNING keystone.server.flask.application [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] Could not find project: 8b8129cff1a0403ea1c6790469938a6e.: keystone.exception.ProjectNotFound: Could not find project: 8b8129cff1a0403ea1c6790469938a6e. Feb 21 01:43:12.886975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1266/2534] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:12 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 21 01:43:12.929072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] MFA Rules not processed for user `eef05bfef54c43ca8d0099ee98986766`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:12.930328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.022778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1269/2535] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:13.301201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.323808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aba8e2-9533-4682-85e3-8bcab38e7597 service glance] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:13.328232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:13.329314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:13.329891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:13.330614 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:13.333044 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:13.363277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:13.364968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:13.376698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1267/2536] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:13.915487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:13.918210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.024545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b0ef1-22fe-465c-93cd-355601f1f311 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:14.029738 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:14.030388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:14.030670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:14.030948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:14.033666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:14.045384 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:14.047055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:14.057659 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1270/2537] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:15.046641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.050132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:15.190683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07ab4b-b563-4991-b84b-3b68041d42be service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.195064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.195253 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.195541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.195818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.197582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:15.261762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.263203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33279127-52c0-4682-8979-5e70f42e9080 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:15.275050 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1268/2538] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:15.795156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:15.797346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:15.817243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c99817-219a-4977-b5e2-44360841a9ff service placement] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:15.823142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:15.824116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:15.824941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:15.825255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] PATH_INFO: `/v3/users/3b98d22b274f4e5e8f4ea3548534a821` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:15.843619 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b98d22b274f4e5e8f4ea3548534a821)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:15.846012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.083438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.083438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.083438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.084151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b98d22b274f4e5e8f4ea3548534a821'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:16.091640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b98d22b274f4e5e8f4ea3548534a821'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:16.120595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] MFA Rules not processed for user `7ae637d5f7f941d8b3b3264c786faddc`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:16.121833 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.125021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b98d22b274f4e5e8f4ea3548534a821'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:16.128421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b98d22b274f4e5e8f4ea3548534a821'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:16.129145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8e4506b1-1ccf-453f-b045-c8a51248df7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b98d22b274f4e5e8f4ea3548534a821'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:16.223687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1269/2539] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:16.237339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.243165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.271654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1271/2540] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:15 2022] DELETE /identity/v3/users/3b98d22b274f4e5e8f4ea3548534a821 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:16.279071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.279978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.280139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.322091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:16.323726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.374888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e141-3b1a-4058-b53a-3681fa471804 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.401156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1272/2541] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:16.426479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:16.428381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:16.471531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.472238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.472526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.472798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.501564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46d113-b1b3-438e-a0c3-c5ce0031c3ee None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:16.505474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:16.506211 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:16.506500 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:16.506779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:16.517771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.519357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.530978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1273/2542] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:16.542627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:16.544396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:16.555964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1270/2543] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:17.252944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:17.255022 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:17.269237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6779b-cfb8-4fb3-8ea3-fa5b28a279b4 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:17.275364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:17.276536 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:17.276931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:17.277273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] PATH_INFO: `/v3/projects/7893fdef34394d6ba4de0526f89244ac` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:17.299234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7893fdef34394d6ba4de0526f89244ac)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:17.302790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:17.431242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:17.441625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe4068-2cfc-401f-9bb8-84f73927adb5 service nova] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:17.451801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:17.453888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:17.454397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:17.454900 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:17.459059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:17.463736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7893fdef34394d6ba4de0526f89244ac', 'request_id': 'req-107f4056-29a9-49da-8331-247c45562fbb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.474238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:17.475741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:17.477750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7893fdef34394d6ba4de0526f89244ac', 'request_id': 'req-107f4056-29a9-49da-8331-247c45562fbb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.486932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1271/2544] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:17.550879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7893fdef34394d6ba4de0526f89244ac', 'request_id': 'req-107f4056-29a9-49da-8331-247c45562fbb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.566202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] The token cache is being invalidate because project 7893fdef34394d6ba4de0526f89244ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:17.566751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.567482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.569172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1274/2545] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:17 2022] DELETE /identity/v3/projects/7893fdef34394d6ba4de0526f89244ac => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:17.573090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:17.585677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5844e-5560-4d1d-8815-9cbbdc4dea6d service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:17.642100 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:17.642967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:17.643251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:17.643528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] PATH_INFO: `/v3/users/23aa0faced4e4e308d4bf3342c61572d` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:17.644786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=23aa0faced4e4e308d4bf3342c61572d)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:17.646765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:17.819636 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23aa0faced4e4e308d4bf3342c61572d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.820773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23aa0faced4e4e308d4bf3342c61572d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.829019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23aa0faced4e4e308d4bf3342c61572d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.841943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23aa0faced4e4e308d4bf3342c61572d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.842686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23aa0faced4e4e308d4bf3342c61572d'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:17.926741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1272/2546] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:17 2022] DELETE /identity/v3/users/23aa0faced4e4e308d4bf3342c61572d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:18.448033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:18.450254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:18.511070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:18.513205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:18.579330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4056-29a9-49da-8331-247c45562fbb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:18.616501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f61d7-d111-41ba-a1f4-87ede37ccf9c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:18.621811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:18.623443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:18.623937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:18.628745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] PATH_INFO: `/v3/projects/149022b161f04c09973b61b865948981` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:18.628745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=149022b161f04c09973b61b865948981)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:18.629255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:18.697366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:18.699302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:18.699302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:18.700194 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:18.703936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:18.719470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:18.722396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc603c-cba1-4e63-922b-0c08efaf5e8a service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:18.748620 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1275/2547] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:18.749898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149022b161f04c09973b61b865948981', 'request_id': 'req-13a98a3f-8ab6-491f-9519-239f7a8534bf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:18.773056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149022b161f04c09973b61b865948981', 'request_id': 'req-13a98a3f-8ab6-491f-9519-239f7a8534bf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:18.780243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149022b161f04c09973b61b865948981', 'request_id': 'req-13a98a3f-8ab6-491f-9519-239f7a8534bf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:18.864439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] The token cache is being invalidate because project 149022b161f04c09973b61b865948981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:18.865254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:18.867004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-13a98a3f-8ab6-491f-9519-239f7a8534bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:18.874857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1273/2548] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:18 2022] DELETE /identity/v3/projects/149022b161f04c09973b61b865948981 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:18.877137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:18.877534 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:18.877914 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:18.897542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:18.898901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:18.963674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1276/2549] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:18.972231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:18.972524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:18.972805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:18.990778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:18.992027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:19.000627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1274/2550] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:19.004647 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.014432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9fd6-14ae-4e9c-8589-7b96a274a790 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.020596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.021289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.021582 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.021868 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.022639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:19.022952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.024584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.040031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1277/2551] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:19.045479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.055957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5ef5a-d31e-46fe-a776-72464f7cc056 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.064331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.065468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.065999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.066535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.067475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.082693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.166474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.183280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1275/2552] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:19 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:19.197300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eefee0-b75f-4e90-8ad3-b3759c5eabb4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.304802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.305475 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.305760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.306043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.306728 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.308717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.391149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1278/2553] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:19 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:19.395167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.412108 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75e5ae-b40f-47ee-8a58-be3d3541715c admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.417998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.419101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.419635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.420226 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.421259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.424577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.437056 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1276/2554] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:19.441387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.456255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02027cb5-1256-40c9-98b1-e51e88d828d1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.463308 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e56e42-61ec-46c0-a110-52799ef4ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.465040 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e56e42-61ec-46c0-a110-52799ef4ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.465445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e56e42-61ec-46c0-a110-52799ef4ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.467787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e56e42-61ec-46c0-a110-52799ef4ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.469955 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e56e42-61ec-46c0-a110-52799ef4ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.472151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e56e42-61ec-46c0-a110-52799ef4ec39 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.486543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1279/2555] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:19.497112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.515355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a1d94-f46a-4552-a036-81d70aac1d41 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.526078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.527173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.528256 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.528726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] PATH_INFO: `/v3/projects/f60d9d272f05498881e4585d290ebf5d/users/6b17a1b903fd4537bdce97e86f629551/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.558442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60d9d272f05498881e4585d290ebf5d, user_id=6b17a1b903fd4537bdce97e86f629551, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.561199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.643207 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1277/2556] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:19 2022] PUT /identity/v3/projects/f60d9d272f05498881e4585d290ebf5d/users/6b17a1b903fd4537bdce97e86f629551/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:19.653734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921c37-93be-402b-a713-d7421454c685 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.654031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921c37-93be-402b-a713-d7421454c685 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.654320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921c37-93be-402b-a713-d7421454c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.687380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f7921c37-93be-402b-a713-d7421454c685 None None] MFA Rules not processed for user `6b17a1b903fd4537bdce97e86f629551`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:19.689306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f7921c37-93be-402b-a713-d7421454c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:19.791007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1280/2557] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:19.792305 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:19.868747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1d09d-0930-466c-b4f6-77a924813931 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:19.874610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:19.875671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:19.877440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:19.878001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:19.878954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:19.883931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:19.992327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1278/2558] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:19 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:19.992802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921c37-93be-402b-a713-d7421454c685 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.007406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921c37-93be-402b-a713-d7421454c685 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.074269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.075618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.075933 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.076213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.076918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.079088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.180541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1281/2559] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:19 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:20.181891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.194358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030afdc-92a2-47de-b86f-3042038b4ebc admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.199545 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.200461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.200666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.200936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.202114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.203797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.221923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1279/2560] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:20.223133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.237776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b67c-41d1-480c-b728-6258ff52fddb admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.245039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.245880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.246374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.246790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] PATH_INFO: `/v3/projects/7d9ec7e9e54e49b5a058ea26627b804c/users/951d9c39071e42e4b98d95cdeafcf8a1/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.280140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9ec7e9e54e49b5a058ea26627b804c, user_id=951d9c39071e42e4b98d95cdeafcf8a1, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.283344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.391901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1282/2561] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:20 2022] PUT /identity/v3/projects/7d9ec7e9e54e49b5a058ea26627b804c/users/951d9c39071e42e4b98d95cdeafcf8a1/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:20.394638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.407315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025c3d-dc89-4112-a09d-fa32bb884d7b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.484271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0d7c6-23d8-467d-8711-d29870d4f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.485484 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0d7c6-23d8-467d-8711-d29870d4f7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.485805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0d7c6-23d8-467d-8711-d29870d4f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.486773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0d7c6-23d8-467d-8711-d29870d4f7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.487526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0d7c6-23d8-467d-8711-d29870d4f7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.489746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0d7c6-23d8-467d-8711-d29870d4f7d7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.505583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1280/2562] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:20.506494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.518052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bd298-cd8e-408c-a9c6-ad10b14381b9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.524747 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e22a5d-6492-4794-8047-731cc2759b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.527028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e22a5d-6492-4794-8047-731cc2759b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.527537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e22a5d-6492-4794-8047-731cc2759b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.528067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e22a5d-6492-4794-8047-731cc2759b3e admin admin] PATH_INFO: `/v3/projects/7d9ec7e9e54e49b5a058ea26627b804c/users/951d9c39071e42e4b98d95cdeafcf8a1/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.531890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e22a5d-6492-4794-8047-731cc2759b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9ec7e9e54e49b5a058ea26627b804c, user_id=951d9c39071e42e4b98d95cdeafcf8a1, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.535887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e22a5d-6492-4794-8047-731cc2759b3e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.560376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1283/2563] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:20 2022] PUT /identity/v3/projects/7d9ec7e9e54e49b5a058ea26627b804c/users/951d9c39071e42e4b98d95cdeafcf8a1/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:20.569991 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.570523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.570653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.605997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] MFA Rules not processed for user `951d9c39071e42e4b98d95cdeafcf8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:20.607327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:20.622778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.623070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.623537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.648745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] MFA Rules not processed for user `7ae637d5f7f941d8b3b3264c786faddc`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:20.650114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:20.709411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1281/2564] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:20.711856 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1284/2565] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:20.723094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:20.724486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:20.779223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99d163-ea20-4c91-82f9-b63729a628f0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:20.783719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:20.784385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:20.784666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:20.784940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:20.794217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:20.795757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:20.805630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1282/2566] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:21.019638 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.021073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.078066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31380234-01ed-44a1-8a07-bcf4b753da16 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.082294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.082938 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.083221 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.083494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.085280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.094908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.096977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b471efb-bd98-4609-84d6-3ba47f07ca15 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.104055 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1285/2567] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:21.183349 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.244382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e6936-441a-4fed-a8db-d09398814526 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.248931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.249779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.250547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.250848 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] PATH_INFO: `/v3/users/6b17a1b903fd4537bdce97e86f629551` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.252062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b17a1b903fd4537bdce97e86f629551)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.253981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.453407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b17a1b903fd4537bdce97e86f629551'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.454087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b17a1b903fd4537bdce97e86f629551'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.460709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b17a1b903fd4537bdce97e86f629551'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.472980 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b17a1b903fd4537bdce97e86f629551'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.473647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b17a1b903fd4537bdce97e86f629551'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:21.569780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1283/2568] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:21 2022] DELETE /identity/v3/users/6b17a1b903fd4537bdce97e86f629551 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:21.572100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.572571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.572571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.592505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:21.594021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.656600 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1286/2569] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:21.666172 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:21.667641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:21.726406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c8eb0-c39b-4082-a0e5-d2031aa9594e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:21.730112 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:21.730780 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:21.731071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:21.731352 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:21.740928 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:21.742353 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:21.752154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1284/2570] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:22.146917 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.148532 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:22.161791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e38ec3-0ba1-4920-9bab-ffdc6a1d05cf None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.166528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.167382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.167670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.168160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] PATH_INFO: `/v3/projects/f60d9d272f05498881e4585d290ebf5d` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.169388 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60d9d272f05498881e4585d290ebf5d)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.171326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.274206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60d9d272f05498881e4585d290ebf5d', 'request_id': 'req-995d0305-0d2a-477c-9324-f97a07902f37'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.279412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60d9d272f05498881e4585d290ebf5d', 'request_id': 'req-995d0305-0d2a-477c-9324-f97a07902f37'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.350439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60d9d272f05498881e4585d290ebf5d', 'request_id': 'req-995d0305-0d2a-477c-9324-f97a07902f37'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.363158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] The token cache is being invalidate because project f60d9d272f05498881e4585d290ebf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:22.363435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.364218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.365762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1287/2571] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:22 2022] DELETE /identity/v3/projects/f60d9d272f05498881e4585d290ebf5d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:22.370014 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:22.380350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613616e-ed80-479a-a0fe-f826fb08addc service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:22.446272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:22.447359 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:22.447821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:22.448309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] PATH_INFO: `/v3/users/951d9c39071e42e4b98d95cdeafcf8a1` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:22.449868 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=951d9c39071e42e4b98d95cdeafcf8a1)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:22.451791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:22.713897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951d9c39071e42e4b98d95cdeafcf8a1'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.714635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951d9c39071e42e4b98d95cdeafcf8a1'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.722739 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951d9c39071e42e4b98d95cdeafcf8a1'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.734230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951d9c39071e42e4b98d95cdeafcf8a1'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.735608 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c4b61554-a777-4be7-b0cb-9c47247f17fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951d9c39071e42e4b98d95cdeafcf8a1'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:22.816882 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1285/2572] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:22 2022] DELETE /identity/v3/users/951d9c39071e42e4b98d95cdeafcf8a1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:23.227071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:23.228625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:23.242306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d0305-0d2a-477c-9324-f97a07902f37 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:23.299291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:23.300174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.300459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.300737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] PATH_INFO: `/v3/projects/7d9ec7e9e54e49b5a058ea26627b804c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.301915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9ec7e9e54e49b5a058ea26627b804c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:23.303951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:23.407756 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9ec7e9e54e49b5a058ea26627b804c', 'request_id': 'req-3e3f146c-35ce-4a8d-8743-17ceb33515f7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:23.413283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9ec7e9e54e49b5a058ea26627b804c', 'request_id': 'req-3e3f146c-35ce-4a8d-8743-17ceb33515f7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:23.465321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9ec7e9e54e49b5a058ea26627b804c', 'request_id': 'req-3e3f146c-35ce-4a8d-8743-17ceb33515f7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:23.479029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] The token cache is being invalidate because project 7d9ec7e9e54e49b5a058ea26627b804c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:23.479324 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:23.480103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3e3f146c-35ce-4a8d-8743-17ceb33515f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:23.481646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1288/2573] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:23 2022] DELETE /identity/v3/projects/7d9ec7e9e54e49b5a058ea26627b804c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:23.487474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb727-af10-4707-ad43-e80532727066 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.487777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb727-af10-4707-ad43-e80532727066 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.488151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb727-af10-4707-ad43-e80532727066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.509200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-4badb727-af10-4707-ad43-e80532727066 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:23.510532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-4badb727-af10-4707-ad43-e80532727066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:23.569700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1286/2574] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:23.577748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.578603 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.578883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.599539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:23.600880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:23.609258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1289/2575] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:23.613842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb727-af10-4707-ad43-e80532727066 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:23.623479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb727-af10-4707-ad43-e80532727066 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:23.628291 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:23.629020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.629304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.629579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.630322 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:23.630630 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:23.632311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:23.647629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1287/2576] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:23.649112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:23.662592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70894b7-0c27-4318-b217-e21082a92baa None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:23.672649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:23.674376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.674930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.676028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.676960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:23.680731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:23.811447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1290/2577] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:23 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:23.813324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:23.823481 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29918dc2-159e-4d69-b4ad-5babfe0c4332 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:23.891302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:23.892605 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:23.893197 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:23.893967 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:23.895311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:23.899119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:23.994602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1288/2578] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:23 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:23.998772 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.009259 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd97851-a9e9-4051-8fcc-92e17e694452 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.014002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.014657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.015504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.015504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.016008 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.017613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.028148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1291/2579] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:24.032817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.043574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c03b3-8c57-442c-9c74-88f6e9738077 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.050459 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73853-f15f-4226-8bac-9cc4ac1114b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.051222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73853-f15f-4226-8bac-9cc4ac1114b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.052028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73853-f15f-4226-8bac-9cc4ac1114b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.052028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73853-f15f-4226-8bac-9cc4ac1114b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.052710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73853-f15f-4226-8bac-9cc4ac1114b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.054330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73853-f15f-4226-8bac-9cc4ac1114b8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.065514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1289/2580] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:24.069690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.081896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd935be-56e3-4297-968d-dfdbb4c9aadf admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.086808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.087721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.088047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.088348 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] PATH_INFO: `/v3/projects/db61964c2f164a40973199deefadaa49/users/864374db8c9e48fdaf5a4df80232296c/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.103983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db61964c2f164a40973199deefadaa49, user_id=864374db8c9e48fdaf5a4df80232296c, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.106633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.179784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1292/2581] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:24 2022] PUT /identity/v3/projects/db61964c2f164a40973199deefadaa49/users/864374db8c9e48fdaf5a4df80232296c/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:24.192332 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.192729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.193107 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.221203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] MFA Rules not processed for user `864374db8c9e48fdaf5a4df80232296c`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:24.223488 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:24.285200 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1290/2582] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:24.289503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.351131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bf248-c82a-432d-b880-a8ffcffb5a95 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.356376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.357029 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.357312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.357594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.358338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.360589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.449469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1293/2583] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:24 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:24.454072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.466541 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc4137-9414-4105-a78c-b4f97c5b73e8 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.560810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.561556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.571444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.571444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.571444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.571444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.632589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.635599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:24.663677 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1291/2584] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:24 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:24.665030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.685620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acfd9-bc69-4837-b4e6-1f7ce4062704 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.691485 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.692288 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.692671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.693025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.693825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.695561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.706454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1292/2585] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:24.710410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.723915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c43f5-4aad-4c33-ab83-1501d96ee1c1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.729896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.730887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.731218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.731569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] PATH_INFO: `/v3/projects/38f27bf19ff94f019fd76692fd7f319f/users/c066d1c1a23b434b9b6147663855724c/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.742031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd59b83-d2cd-4797-906c-61a25e24b8a3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.748555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.750517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.750978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.751310 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f27bf19ff94f019fd76692fd7f319f, user_id=c066d1c1a23b434b9b6147663855724c, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.751613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.754458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:24.755036 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.769851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.774685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.791478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1294/2586] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:43:24.833309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1293/2587] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:24 2022] PUT /identity/v3/projects/38f27bf19ff94f019fd76692fd7f319f/users/c066d1c1a23b434b9b6147663855724c/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:24.840144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.872871 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6173f-953d-4641-ae34-5b793e466049 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.942397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c970fa-618d-4c1d-9769-4d90e0ed69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.943092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c970fa-618d-4c1d-9769-4d90e0ed69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.943379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c970fa-618d-4c1d-9769-4d90e0ed69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.943687 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c970fa-618d-4c1d-9769-4d90e0ed69d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.944479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c970fa-618d-4c1d-9769-4d90e0ed69d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.946085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c970fa-618d-4c1d-9769-4d90e0ed69d4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:24.957015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1295/2588] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:24.961199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:24.977199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a441-1420-4ce7-8a1f-274b9c639d9a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:24.986004 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:24.986940 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:24.987233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:24.987507 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] PATH_INFO: `/v3/projects/38f27bf19ff94f019fd76692fd7f319f/users/c066d1c1a23b434b9b6147663855724c/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:24.990073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f27bf19ff94f019fd76692fd7f319f, user_id=c066d1c1a23b434b9b6147663855724c, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:24.993350 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:25.007777 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1294/2589] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:24 2022] PUT /identity/v3/projects/38f27bf19ff94f019fd76692fd7f319f/users/c066d1c1a23b434b9b6147663855724c/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:25.075160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:25.075372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:25.075649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:25.107456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] MFA Rules not processed for user `c066d1c1a23b434b9b6147663855724c`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:25.108841 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:25.194949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1296/2590] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:25.204864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:25.206560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:25.263521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc21f1-7275-416c-a255-a18792d045fb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:25.267284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b536c-9803-4415-99ac-7cc9d15ab9fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:25.267973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b536c-9803-4415-99ac-7cc9d15ab9fb service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:25.268266 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b536c-9803-4415-99ac-7cc9d15ab9fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:25.268546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b536c-9803-4415-99ac-7cc9d15ab9fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:25.278549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b536c-9803-4415-99ac-7cc9d15ab9fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:25.280018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b536c-9803-4415-99ac-7cc9d15ab9fb service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:25.289896 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1295/2591] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:28.319361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.379857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd709ef1-91a4-4beb-9d27-6c6bf0f12b9e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.384395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.385253 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.385538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.385817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] PATH_INFO: `/v3/users/864374db8c9e48fdaf5a4df80232296c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.387028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864374db8c9e48fdaf5a4df80232296c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.388967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.553412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864374db8c9e48fdaf5a4df80232296c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.560980 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864374db8c9e48fdaf5a4df80232296c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.576244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864374db8c9e48fdaf5a4df80232296c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.576996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864374db8c9e48fdaf5a4df80232296c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.577607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864374db8c9e48fdaf5a4df80232296c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:28.647567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1297/2592] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:28 2022] DELETE /identity/v3/users/864374db8c9e48fdaf5a4df80232296c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:28.652082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.652582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.652691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.670516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:28.672078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:28.731794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1296/2593] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:28.741383 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:28.742775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:28.797333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b842c6-2fc9-4523-8596-b56c02b414d6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:28.801063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:28.801697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:28.801977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:28.802252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:28.811496 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:28.813533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:28.822967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1298/2594] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:29.249117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.256532 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:29.263216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c951692-bbfc-4d99-9062-ec6df2b152c0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.267910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.268793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.269227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.269514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] PATH_INFO: `/v3/projects/db61964c2f164a40973199deefadaa49` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.271342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db61964c2f164a40973199deefadaa49)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.273483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.385509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db61964c2f164a40973199deefadaa49', 'request_id': 'req-462613ee-601b-4bdb-a27c-9d1054a5b010'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.391444 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db61964c2f164a40973199deefadaa49', 'request_id': 'req-462613ee-601b-4bdb-a27c-9d1054a5b010'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.396785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db61964c2f164a40973199deefadaa49', 'request_id': 'req-462613ee-601b-4bdb-a27c-9d1054a5b010'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.490726 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] The token cache is being invalidate because project db61964c2f164a40973199deefadaa49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:29.491011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.491634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.493228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1297/2595] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:29 2022] DELETE /identity/v3/projects/db61964c2f164a40973199deefadaa49 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:29.497273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:29.507414 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbfbdb-fd9e-4270-92e6-f13464d088cf service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:29.564877 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:29.565874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:29.566156 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:29.566429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] PATH_INFO: `/v3/users/c066d1c1a23b434b9b6147663855724c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:29.567668 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c066d1c1a23b434b9b6147663855724c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:29.569618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:29.761287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c066d1c1a23b434b9b6147663855724c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.768706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c066d1c1a23b434b9b6147663855724c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.780339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c066d1c1a23b434b9b6147663855724c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.781722 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c066d1c1a23b434b9b6147663855724c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.782530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1f915500-4233-4b81-80bd-954d28bc2a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c066d1c1a23b434b9b6147663855724c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:29.851273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1299/2596] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:29 2022] DELETE /identity/v3/users/c066d1c1a23b434b9b6147663855724c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:30.326640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:30.330634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:30.344263 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462613ee-601b-4bdb-a27c-9d1054a5b010 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:30.402389 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:30.403246 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:30.403531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:30.403864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] PATH_INFO: `/v3/projects/38f27bf19ff94f019fd76692fd7f319f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:30.407294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f27bf19ff94f019fd76692fd7f319f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:30.409486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:30.542111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f27bf19ff94f019fd76692fd7f319f', 'request_id': 'req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:30.548457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f27bf19ff94f019fd76692fd7f319f', 'request_id': 'req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:30.553617 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f27bf19ff94f019fd76692fd7f319f', 'request_id': 'req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:30.633345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] The token cache is being invalidate because project 38f27bf19ff94f019fd76692fd7f319f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:30.633642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:30.634276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-58f9a4d1-c8ec-4f26-a7ab-928bbcd2d69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:30.635936 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1298/2597] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:30 2022] DELETE /identity/v3/projects/38f27bf19ff94f019fd76692fd7f319f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:30.641890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:30.642405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:30.642513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:30.660989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:30.666694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:30.723810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1300/2598] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:30.731579 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:30.731912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:30.732203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:30.751737 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:30.752968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:30.760874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1299/2599] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:30.765079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:30.775241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e9d77-50fd-4c0b-a6df-4690c9379430 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:30.779886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:30.780544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:30.780999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:30.781382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:30.782222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:30.782533 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:30.784152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:30.795715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1301/2600] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:30.800132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:30.809093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a597f-2a7e-4fcd-badf-7df8494becc7 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:30.815825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:30.816508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:30.816795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:30.817076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:30.817770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:30.819952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:30.919391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1300/2601] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:30 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:30.920428 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:30.933400 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f1799-e3e7-4708-a13c-06fffd0af1f9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.001167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.001929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.002220 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.002513 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.003240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.005185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.096677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1302/2602] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:30 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:43:31.103090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.113604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24536f33-09cd-4599-8a0c-34d8ba9b4fe1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.118166 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.118808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.119090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.119365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.120122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.121734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.132409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1301/2603] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:31.137911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.147673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc440e52-e739-470d-8a26-60e237b3b1cc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.152258 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcaa0c-977d-42f9-9995-c98642af9ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.152906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcaa0c-977d-42f9-9995-c98642af9ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.153191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcaa0c-977d-42f9-9995-c98642af9ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.153467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcaa0c-977d-42f9-9995-c98642af9ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.154180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcaa0c-977d-42f9-9995-c98642af9ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.155748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcaa0c-977d-42f9-9995-c98642af9ea3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.165273 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1303/2604] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:31.169477 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.179521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4df2e-a50b-4887-bfb4-48cc97be12b5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.184130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.184981 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.185261 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.185538 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] PATH_INFO: `/v3/projects/73a7a40784d74b1ab6a60f40c98b848c/users/76d6f6e5e6bf486f9798b71a479f0873/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.200040 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a7a40784d74b1ab6a60f40c98b848c, user_id=76d6f6e5e6bf486f9798b71a479f0873, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.202801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.302249 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1302/2605] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:31 2022] PUT /identity/v3/projects/73a7a40784d74b1ab6a60f40c98b848c/users/76d6f6e5e6bf486f9798b71a479f0873/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:31.314448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.314766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.315049 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.340639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] MFA Rules not processed for user `76d6f6e5e6bf486f9798b71a479f0873`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:31.341835 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:31.404286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1304/2606] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:31.408871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.469340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026a846-60db-4c1a-8fc3-ebd81483c24d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.474429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.475105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.475423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.475703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.476437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.478410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.556078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1303/2607] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:31 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:31.560143 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.571585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed2809-3bf1-47af-a01d-23fe0f554eb2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.626664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.627318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.627599 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.627898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.628590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.630485 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.750628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1305/2608] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:31 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:31.754548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.764670 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ceaaf4-1978-43b7-950a-fea964e0f5c7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.769558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.770206 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.770493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.770771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.771552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.773180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.784142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1304/2609] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:31.788252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.798817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199d92-8e30-4804-96ab-8b9c1bd7ca54 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.803468 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.804391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.804674 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.804951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] PATH_INFO: `/v3/projects/262758fef01e426bb6c17c03e415c677/users/5c29a069a66941a7b7d487fb41e7b819/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.818998 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262758fef01e426bb6c17c03e415c677, user_id=5c29a069a66941a7b7d487fb41e7b819, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.821670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.887231 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1306/2610] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:31 2022] PUT /identity/v3/projects/262758fef01e426bb6c17c03e415c677/users/5c29a069a66941a7b7d487fb41e7b819/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:31.891798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.901622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417eead-c3c7-41d3-95e7-cdf4019ab8e9 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.960995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f7af-272b-4587-b491-40524b97b0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.961652 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f7af-272b-4587-b491-40524b97b0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.961934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f7af-272b-4587-b491-40524b97b0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.962204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f7af-272b-4587-b491-40524b97b0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:31.962913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f7af-272b-4587-b491-40524b97b0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:31.964531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f7af-272b-4587-b491-40524b97b0c0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:31.976179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1305/2611] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:43:31.980341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:31.991014 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa0932-1f01-4e27-90b7-d1678aa8e5a2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:31.996797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:31.997800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:31.998196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:31.998625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] PATH_INFO: `/v3/projects/262758fef01e426bb6c17c03e415c677/users/5c29a069a66941a7b7d487fb41e7b819/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:32.002311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] RBAC: Authorizing `identity:create_grant(project_id=262758fef01e426bb6c17c03e415c677, user_id=5c29a069a66941a7b7d487fb41e7b819, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:32.005160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:32.019870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1307/2612] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:31 2022] PUT /identity/v3/projects/262758fef01e426bb6c17c03e415c677/users/5c29a069a66941a7b7d487fb41e7b819/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:32.028344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:32.028642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:32.028930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:32.061506 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] MFA Rules not processed for user `5c29a069a66941a7b7d487fb41e7b819`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:32.062958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:32.145659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1306/2613] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:32.154408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:32.157155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:32.214692 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b59f6-a59e-48cb-92ec-81cccd3fabda admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:32.218754 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:32.219392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:32.219675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:32.219992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:32.228991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:32.230417 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:32.239982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1308/2614] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:32.335732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:32.346386 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd07c-27fa-440c-a04a-7e113ab6e958 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:32.350327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a06258-e871-4b5d-9d8f-56a1cebc4df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:32.351019 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a06258-e871-4b5d-9d8f-56a1cebc4df2 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:32.351363 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a06258-e871-4b5d-9d8f-56a1cebc4df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:32.351643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a06258-e871-4b5d-9d8f-56a1cebc4df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:32.408465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a06258-e871-4b5d-9d8f-56a1cebc4df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:32.409897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a06258-e871-4b5d-9d8f-56a1cebc4df2 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:32.418861 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1307/2615] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:35.467027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:35.535753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd86b-284e-48b8-ad49-a71cee723969 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:35.540598 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:35.541463 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:35.541873 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:35.542160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] PATH_INFO: `/v3/users/76d6f6e5e6bf486f9798b71a479f0873` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:35.543458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d6f6e5e6bf486f9798b71a479f0873)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:35.545409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:35.712360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d6f6e5e6bf486f9798b71a479f0873'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:35.719410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d6f6e5e6bf486f9798b71a479f0873'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:35.730671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d6f6e5e6bf486f9798b71a479f0873'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:35.731448 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d6f6e5e6bf486f9798b71a479f0873'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:35.732087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d6f6e5e6bf486f9798b71a479f0873'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:35.804861 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1309/2616] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:35 2022] DELETE /identity/v3/users/76d6f6e5e6bf486f9798b71a479f0873 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:35.809416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:35.809952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:35.809952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:35.827653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:35.828881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:35.891277 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1308/2617] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:35.903201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:35.908698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:35.971641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faaf6f-5b7e-4305-a39d-a999e21d7eef admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:35.975205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:35.975874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:35.976190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:35.976498 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:35.986859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:35.988344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:35.997990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1310/2618] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:36.400965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:36.402866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:36.416168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d816333-75a9-4b16-907a-ec9b4bb9c8cb None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:36.420885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:36.425691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:36.425691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:36.425691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] PATH_INFO: `/v3/projects/73a7a40784d74b1ab6a60f40c98b848c` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:36.425691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a7a40784d74b1ab6a60f40c98b848c)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:36.426133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:36.552746 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a7a40784d74b1ab6a60f40c98b848c', 'request_id': 'req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.558621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a7a40784d74b1ab6a60f40c98b848c', 'request_id': 'req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.564448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a7a40784d74b1ab6a60f40c98b848c', 'request_id': 'req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.649355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] The token cache is being invalidate because project 73a7a40784d74b1ab6a60f40c98b848c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:36.649640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.650264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.651789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1309/2619] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:36 2022] DELETE /identity/v3/projects/73a7a40784d74b1ab6a60f40c98b848c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:36.656816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:36.666238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bee35-b5e7-4a77-b306-8158b75f7449 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:36.720899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:36.721743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:36.722024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:36.722304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] PATH_INFO: `/v3/users/5c29a069a66941a7b7d487fb41e7b819` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:36.723471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c29a069a66941a7b7d487fb41e7b819)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:36.725412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:36.904581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c29a069a66941a7b7d487fb41e7b819'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.911652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c29a069a66941a7b7d487fb41e7b819'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.923566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c29a069a66941a7b7d487fb41e7b819'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.924270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c29a069a66941a7b7d487fb41e7b819'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:36.925050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b66f22c5-3fae-4078-a6db-e7f5d3d28c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c29a069a66941a7b7d487fb41e7b819'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:37.012594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1311/2620] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:36 2022] DELETE /identity/v3/users/5c29a069a66941a7b7d487fb41e7b819 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:37.380932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:37.383588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:37.396597 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932fbbe-e7cb-44d0-802b-b0c1ad89a06e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:37.452547 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:37.453381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:37.453667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:37.453949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] PATH_INFO: `/v3/projects/262758fef01e426bb6c17c03e415c677` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:37.455139 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=262758fef01e426bb6c17c03e415c677)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:37.457069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:37.532396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262758fef01e426bb6c17c03e415c677', 'request_id': 'req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:37.538493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262758fef01e426bb6c17c03e415c677', 'request_id': 'req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:37.543870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262758fef01e426bb6c17c03e415c677', 'request_id': 'req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:37.605642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] The token cache is being invalidate because project 262758fef01e426bb6c17c03e415c677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:37.605931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:37.606555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-c5f2c561-de2b-4ff9-b345-8ad12b0772ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:37.608162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1310/2621] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:37 2022] DELETE /identity/v3/projects/262758fef01e426bb6c17c03e415c677 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:37.613785 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:37.614133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:37.614416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:37.631705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:37.632927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:37.689671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1312/2622] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:37.697367 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:37.697667 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:37.697952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:37.716347 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:37.717801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:37.726474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1311/2623] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:37.730617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:37.740601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0a9e5-922c-4fa4-9bbf-3190c09b8589 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:37.745091 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:37.745732 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:37.746009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:37.746281 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:37.746991 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:37.747296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:37.748900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:37.760353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1313/2624] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:37.764375 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:37.773491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be0499-0c0a-40ac-b6a3-700d48889a1e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:37.778185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:37.778818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:37.779102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:37.779382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:37.780128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:37.782750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:37.961303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1312/2625] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:37 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:37.965329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:37.976314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853b65-551f-4455-9a21-4886a3bdbf4f admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.032460 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.033129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.033419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.033697 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.034398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.036334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.153294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1314/2626] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:37 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:38.158085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.168628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c0173-62d3-48c8-b448-b45efdd195ff admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.173598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.174240 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.174574 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.174857 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.175580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.177211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.187796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1313/2627] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:38.191474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.201126 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d514af-35c4-4ffe-a8b6-38af77dad6f1 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.206444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f887e77-9e12-4fb3-b48c-669019f7843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.207095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f887e77-9e12-4fb3-b48c-669019f7843c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.207377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f887e77-9e12-4fb3-b48c-669019f7843c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.207653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f887e77-9e12-4fb3-b48c-669019f7843c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.208407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f887e77-9e12-4fb3-b48c-669019f7843c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.209978 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f887e77-9e12-4fb3-b48c-669019f7843c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.220155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1315/2628] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:38.224148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.234546 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15849aaf-4939-43c1-b707-24072705f6ae admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.239122 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.240024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.240313 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.240596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] PATH_INFO: `/v3/projects/abfba0d73d5b4e0c9e30752afbfd8d08/users/9195779c78ca42209866b863c81e6e69/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.256238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfba0d73d5b4e0c9e30752afbfd8d08, user_id=9195779c78ca42209866b863c81e6e69, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.258884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.325397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1314/2629] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:38 2022] PUT /identity/v3/projects/abfba0d73d5b4e0c9e30752afbfd8d08/users/9195779c78ca42209866b863c81e6e69/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:38.339525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.339936 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.340291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.368129 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] MFA Rules not processed for user `9195779c78ca42209866b863c81e6e69`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:38.369343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:38.432739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1316/2630] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:38.437930 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.497265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61d92f-c81d-493e-9bcc-df1bedff5799 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.502473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.503110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.503390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.503665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.504391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.506292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.595178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1315/2631] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:38 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:38.599267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.610739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b93ef-2dad-4506-a01e-ad50aec07a21 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.664666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.665326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.665609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.665886 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.666573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.668506 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.738895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1317/2632] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:38 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:38.742832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.753692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e6dcb0-7396-471e-9b02-76be9f844a50 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.758247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.758892 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.759176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.759455 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.760217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.761881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.772276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1316/2633] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:38.776225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.786283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be732ab-6a61-4e1d-a48e-808dade12679 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.791012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.791902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.792200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.792467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] PATH_INFO: `/v3/projects/835ba7a5f0c1436f9bc4103f67d825f6/users/e2678b48465f45dfab4085cc1b5a3ac7/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.807165 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=835ba7a5f0c1436f9bc4103f67d825f6, user_id=e2678b48465f45dfab4085cc1b5a3ac7, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.809859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.882006 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1318/2634] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:38 2022] PUT /identity/v3/projects/835ba7a5f0c1436f9bc4103f67d825f6/users/e2678b48465f45dfab4085cc1b5a3ac7/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:38.885990 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.896222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c1231-6bb1-4b68-aac2-ac32d5c54b5a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.951348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d18e0-40ee-4eae-8511-a31a117f9fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.952038 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d18e0-40ee-4eae-8511-a31a117f9fae admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.952517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d18e0-40ee-4eae-8511-a31a117f9fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.952836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d18e0-40ee-4eae-8511-a31a117f9fae admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.953565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d18e0-40ee-4eae-8511-a31a117f9fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.955228 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d18e0-40ee-4eae-8511-a31a117f9fae admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:38.964873 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1317/2635] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:38.969749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:38.980113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b335-957e-406b-af29-a37c657bf1fa admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:38.985864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:38.986736 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:38.987020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:38.987298 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] PATH_INFO: `/v3/projects/835ba7a5f0c1436f9bc4103f67d825f6/users/e2678b48465f45dfab4085cc1b5a3ac7/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:38.989307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835ba7a5f0c1436f9bc4103f67d825f6, user_id=e2678b48465f45dfab4085cc1b5a3ac7, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:38.991947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:39.002121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1319/2636] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:38 2022] PUT /identity/v3/projects/835ba7a5f0c1436f9bc4103f67d825f6/users/e2678b48465f45dfab4085cc1b5a3ac7/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:39.012196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:39.012421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:39.012696 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:39.038850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] MFA Rules not processed for user `e2678b48465f45dfab4085cc1b5a3ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:39.041083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:39.104116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1318/2637] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:39.114076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:39.115807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:39.169789 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a67e8-017a-4db6-b76d-d9434d186508 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:39.174288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:39.174920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:39.175206 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:39.175487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:39.228201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:39.229617 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:39.238699 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1320/2638] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:46.522983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:46.532684 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b4173-f610-4e4c-918d-5ffd05863d77 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:46.536454 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347516-cd8f-4133-82c1-a26195a093ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:46.537102 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347516-cd8f-4133-82c1-a26195a093ad service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:46.537386 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347516-cd8f-4133-82c1-a26195a093ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:46.537657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347516-cd8f-4133-82c1-a26195a093ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:46.546437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3347516-cd8f-4133-82c1-a26195a093ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:46.547862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3347516-cd8f-4133-82c1-a26195a093ad service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:46.557021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1319/2639] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:52.320234 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:52.382373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f0c57-c33b-4006-9143-eef21f3a8530 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:52.387146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:52.388036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:52.388321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:52.388624 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] PATH_INFO: `/v3/users/9195779c78ca42209866b863c81e6e69` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:52.389827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9195779c78ca42209866b863c81e6e69)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:52.391780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:52.589494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9195779c78ca42209866b863c81e6e69'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:52.597026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9195779c78ca42209866b863c81e6e69'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:52.609042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9195779c78ca42209866b863c81e6e69'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:52.609531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9195779c78ca42209866b863c81e6e69'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:52.610153 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9195779c78ca42209866b863c81e6e69'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:52.689984 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1321/2640] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:52 2022] DELETE /identity/v3/users/9195779c78ca42209866b863c81e6e69 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:52.694916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:52.694916 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:52.699697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:52.714265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:52.715450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:52.775568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1320/2641] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:52.785751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:52.787267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:52.844172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5544e8-42e4-4e15-b557-8b6833658a87 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:52.848857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:52.849507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:52.849794 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:52.850074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:52.859210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:52.860721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:52.870245 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1322/2642] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:53.276747 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:53.283439 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:53.290145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45705ffb-715c-4526-a05c-66d8c7b227d1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:53.294768 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:53.295611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:53.295918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:53.296195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] PATH_INFO: `/v3/projects/abfba0d73d5b4e0c9e30752afbfd8d08` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:53.297585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfba0d73d5b4e0c9e30752afbfd8d08)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:53.299655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:53.406576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfba0d73d5b4e0c9e30752afbfd8d08', 'request_id': 'req-6c61fc27-6b8b-4196-8726-a52795ee3535'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.412886 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfba0d73d5b4e0c9e30752afbfd8d08', 'request_id': 'req-6c61fc27-6b8b-4196-8726-a52795ee3535'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.418151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfba0d73d5b4e0c9e30752afbfd8d08', 'request_id': 'req-6c61fc27-6b8b-4196-8726-a52795ee3535'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.506637 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] The token cache is being invalidate because project abfba0d73d5b4e0c9e30752afbfd8d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:53.506966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.507638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.509254 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1321/2643] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:53 2022] DELETE /identity/v3/projects/abfba0d73d5b4e0c9e30752afbfd8d08 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:53.513368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:53.522927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93400998-ba7b-4d27-a8ad-8b58517f91b8 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:53.579671 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:53.580625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:53.580902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:53.581173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] PATH_INFO: `/v3/users/e2678b48465f45dfab4085cc1b5a3ac7` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:53.582397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2678b48465f45dfab4085cc1b5a3ac7)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:53.584336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:53.790950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2678b48465f45dfab4085cc1b5a3ac7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.797502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2678b48465f45dfab4085cc1b5a3ac7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.809249 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2678b48465f45dfab4085cc1b5a3ac7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.809911 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2678b48465f45dfab4085cc1b5a3ac7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.810507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0f94c20-0cb2-4282-a8e8-2231a6d0b000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2678b48465f45dfab4085cc1b5a3ac7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:53.918217 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1323/2644] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:53 2022] DELETE /identity/v3/users/e2678b48465f45dfab4085cc1b5a3ac7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:54.628111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:54.629691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:54.642782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61fc27-6b8b-4196-8726-a52795ee3535 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:54.697489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:54.698330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:54.698616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:54.698893 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] PATH_INFO: `/v3/projects/835ba7a5f0c1436f9bc4103f67d825f6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:54.700190 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=835ba7a5f0c1436f9bc4103f67d825f6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:54.702144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:54.823986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835ba7a5f0c1436f9bc4103f67d825f6', 'request_id': 'req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.830089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835ba7a5f0c1436f9bc4103f67d825f6', 'request_id': 'req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.835727 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835ba7a5f0c1436f9bc4103f67d825f6', 'request_id': 'req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.915558 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] The token cache is being invalidate because project 835ba7a5f0c1436f9bc4103f67d825f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:54.915779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.916492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-dc0570c8-124a-4dd7-8e06-4cd6e93c50a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:54.918039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1322/2645] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:54 2022] DELETE /identity/v3/projects/835ba7a5f0c1436f9bc4103f67d825f6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:54.924611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:54.925158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:54.925318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:54.944111 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:54.949749 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:55.004225 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1324/2646] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:55.013929 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.014222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.014499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.034074 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:55.035272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:55.043387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1323/2647] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:55.048028 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.061019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217279a0-b1e9-4843-8a5a-a4664623a6e8 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.066466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.067243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.067530 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.067805 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.068631 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:43:55.068902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.070470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.082537 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1325/2648] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:43:55.090184 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.100405 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cecb7-179c-4491-b470-59b03e9d874f None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.105314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.105955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.106239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.106517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.107218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.109145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.245588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1324/2649] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:55.249882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.260817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cf4d2-d3bb-4e99-a50b-1716c42b698c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.317264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.317925 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.318209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.318486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.319162 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.321072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.438551 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1326/2650] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:43:55.443211 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.453273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11500a2-ca98-461b-947d-933406126b09 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.458819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.459448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.459735 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.460052 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.463129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.463129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.473209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1325/2651] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:55.477007 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.486932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5154a-5d0b-484e-96ff-67c708c0c4b6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.491526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5e5fd-7ce6-4f12-ab55-b017a94358c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.493958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e5fd-7ce6-4f12-ab55-b017a94358c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.493958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e5fd-7ce6-4f12-ab55-b017a94358c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.493958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5e5fd-7ce6-4f12-ab55-b017a94358c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.493958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5e5fd-7ce6-4f12-ab55-b017a94358c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.495020 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5e5fd-7ce6-4f12-ab55-b017a94358c8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.505494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1327/2652] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:43:55.509593 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.521472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad2832-7cdf-48ab-a964-2dab716d89e0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.526339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.527198 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.527474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.527751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] PATH_INFO: `/v3/projects/3140d8726cbf48218fd05ded11e09462/users/433ce0c50f224e6bac70005353b6c7e7/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.542369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3140d8726cbf48218fd05ded11e09462, user_id=433ce0c50f224e6bac70005353b6c7e7, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.545662 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.627514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1326/2653] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:43:55 2022] PUT /identity/v3/projects/3140d8726cbf48218fd05ded11e09462/users/433ce0c50f224e6bac70005353b6c7e7/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:43:55.638843 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.639146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.639420 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.665735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] MFA Rules not processed for user `433ce0c50f224e6bac70005353b6c7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:55.666951 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:55.731235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1328/2654] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:43:55.741535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.743241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:55.799000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef50c74-707d-45b4-a3a4-6bde8a392299 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.802691 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bf084-5e32-418c-9e0b-0d4a0725bfb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.803330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf084-5e32-418c-9e0b-0d4a0725bfb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.803618 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf084-5e32-418c-9e0b-0d4a0725bfb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.803926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bf084-5e32-418c-9e0b-0d4a0725bfb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.812271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bf084-5e32-418c-9e0b-0d4a0725bfb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.813699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bf084-5e32-418c-9e0b-0d4a0725bfb7 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:55.822522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1327/2655] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:55.849120 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:55.913790 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f28c-ae77-439f-92bb-be52097c7211 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:55.918540 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:55.919431 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:55.919715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:55.920037 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] PATH_INFO: `/v3/users/433ce0c50f224e6bac70005353b6c7e7` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:55.921240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433ce0c50f224e6bac70005353b6c7e7)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:55.923145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.111715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433ce0c50f224e6bac70005353b6c7e7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.118494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433ce0c50f224e6bac70005353b6c7e7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.131090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433ce0c50f224e6bac70005353b6c7e7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.131820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433ce0c50f224e6bac70005353b6c7e7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.132469 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433ce0c50f224e6bac70005353b6c7e7'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.197904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1329/2656] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:43:55 2022] DELETE /identity/v3/users/433ce0c50f224e6bac70005353b6c7e7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:43:56.202390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.205516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.205516 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.221464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:43:56.222713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:56.287467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1328/2657] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:43:56.297297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.298812 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:56.356667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7efece-6739-47bc-82b4-f5ff4a269f40 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.360394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.361128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.361451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.361700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.371267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.372771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.383432 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1330/2658] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:43:56.794059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:43:56.797496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:43:56.808508 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657993c1-0639-49dc-99f0-ffad910ce25e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:43:56.815016 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:43:56.817725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:43:56.818413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:43:56.818710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] PATH_INFO: `/v3/projects/3140d8726cbf48218fd05ded11e09462` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:43:56.820410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3140d8726cbf48218fd05ded11e09462)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:43:56.827523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:43:56.948820 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3140d8726cbf48218fd05ded11e09462', 'request_id': 'req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.955470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3140d8726cbf48218fd05ded11e09462', 'request_id': 'req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:56.961163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3140d8726cbf48218fd05ded11e09462', 'request_id': 'req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:57.076904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] The token cache is being invalidate because project 3140d8726cbf48218fd05ded11e09462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:43:57.077195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:57.077824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:43:57.079365 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1329/2659] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:43:56 2022] DELETE /identity/v3/projects/3140d8726cbf48218fd05ded11e09462 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:23.634227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:23.642883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be3969-0ed5-4013-afa1-55e5d63b5153 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:23.690934 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:23.691611 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:23.691918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:23.692202 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:23.694885 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:23.887550 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:23.888941 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:23.898394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1331/2660] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:24.512576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:24.514135 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:24.528078 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52836c72-0686-4bc6-bf5e-80ba44f8b6a8 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:24.532904 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:24.533846 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:24.534195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:24.534476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] PATH_INFO: `/v3/users/eef05bfef54c43ca8d0099ee98986766` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:24.535689 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef05bfef54c43ca8d0099ee98986766)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:24.538236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:24.707155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef05bfef54c43ca8d0099ee98986766'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.707859 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef05bfef54c43ca8d0099ee98986766'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.715713 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef05bfef54c43ca8d0099ee98986766'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.727533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef05bfef54c43ca8d0099ee98986766'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.728189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-6d072108-cd14-47b0-9273-a6c919bf3da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef05bfef54c43ca8d0099ee98986766'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:24.784373 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1330/2661] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:44:24 2022] DELETE /identity/v3/users/eef05bfef54c43ca8d0099ee98986766 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:25.018632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.028849 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603e7c4-771f-47bf-a72a-d1deed344ccf service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.083957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.084834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.085116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.085398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] PATH_INFO: `/v3/projects/f92cb7cf852c4790bb51e02de8b46c41` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.086575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92cb7cf852c4790bb51e02de8b46c41)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.088487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.205418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92cb7cf852c4790bb51e02de8b46c41', 'request_id': 'req-ed48a166-729d-48c8-aca6-0d0709d26fbf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:25.210844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92cb7cf852c4790bb51e02de8b46c41', 'request_id': 'req-ed48a166-729d-48c8-aca6-0d0709d26fbf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:25.288368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92cb7cf852c4790bb51e02de8b46c41', 'request_id': 'req-ed48a166-729d-48c8-aca6-0d0709d26fbf'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:25.299192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] The token cache is being invalidate because project f92cb7cf852c4790bb51e02de8b46c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:44:25.299402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:25.300058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-ed48a166-729d-48c8-aca6-0d0709d26fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:44:25.301567 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1332/2662] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:44:25 2022] DELETE /identity/v3/projects/f92cb7cf852c4790bb51e02de8b46c41 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:25.307143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.307437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.307734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.327472 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:25.328736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:25.386811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1331/2663] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:44:25.394321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.394616 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.394900 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.414329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:25.415523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:25.423499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1333/2664] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:25.428410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.437730 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d2ec-ac0d-4fd3-8e2d-1128c322fb3e None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.442864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.443591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.443912 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.444195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.444922 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:44:25.445232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.446817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.459015 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1332/2665] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:44:25.462614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.471929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891f46e-9fff-4e3d-b70f-cb5b7a36b0aa None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.477264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.477910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.478196 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.478474 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.479168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.481067 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.568946 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1334/2666] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:25.572874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.582690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365ecf-f8b8-4b10-b9fe-4d10cb4b4085 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.637072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.637725 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.638010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.638283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.638960 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.640887 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.750180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1333/2667] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:25.754218 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.764381 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26107f67-498d-4510-b411-dff692f4fd70 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.768939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.769586 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.772296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.772296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.772296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.772922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.783261 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1335/2668] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:25.787911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.797711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef59db7-be90-4cdd-8971-728d79b45669 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.802500 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52913ac0-2ea6-44ff-bf67-60c3633b3125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.803231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52913ac0-2ea6-44ff-bf67-60c3633b3125 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.803521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52913ac0-2ea6-44ff-bf67-60c3633b3125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.803798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52913ac0-2ea6-44ff-bf67-60c3633b3125 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.804552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52913ac0-2ea6-44ff-bf67-60c3633b3125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.806138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52913ac0-2ea6-44ff-bf67-60c3633b3125 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.815818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1334/2669] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:44:25.820149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:25.829775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb6b1-0152-4c97-bb71-c65c1d27e15c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:25.835070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:25.835944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.836232 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.836512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] PATH_INFO: `/v3/projects/caf92606a26e43e19b60a51e3eddad9d/users/0984cd81d2274ef1b480eec8584d780f/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.852183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf92606a26e43e19b60a51e3eddad9d, user_id=0984cd81d2274ef1b480eec8584d780f, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:25.854830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:25.931850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1336/2670] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:25 2022] PUT /identity/v3/projects/caf92606a26e43e19b60a51e3eddad9d/users/0984cd81d2274ef1b480eec8584d780f/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:25.936942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b9ff-30f6-4b89-867b-74ca75008ab1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:25.937239 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b9ff-30f6-4b89-867b-74ca75008ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:25.937524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b9ff-30f6-4b89-867b-74ca75008ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:25.954905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a419b9ff-30f6-4b89-867b-74ca75008ab1 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:25.956145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a419b9ff-30f6-4b89-867b-74ca75008ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:26.013755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1335/2671] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:26.023910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:26.025614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:26.078806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7db0c2-acf9-4e32-8fc0-6a4652fef8e6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:26.082350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:26.083168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:26.084073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:26.084357 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:26.093479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:26.095002 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:26.105021 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1337/2672] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:31.675406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:31.675947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:31.675947 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:31.704966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] MFA Rules not processed for user `0984cd81d2274ef1b480eec8584d780f`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:31.706000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:31.775060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1336/2673] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:44:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:31.779644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:31.790027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8648a3-d704-4290-9231-724d0877d98e service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:31.794786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:31.795519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:31.795899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:31.796241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:31.797019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:31.799094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:31.890639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1338/2674] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:44:31 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:44:31.901712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:31.913945 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090b5af-f35d-460e-b309-dca1dc4cfb6b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:31.975548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:31.976243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:31.976528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:31.976805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:31.977594 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:31.979519 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:32.077491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1337/2675] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:44:31 2022] POST /identity/v3/users => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:44:32.081422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:32.093891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011f93d-3924-44b4-8e74-4889a17071de admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:32.106585 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:32.109133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:32.109133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:32.109133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:32.109133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:32.110131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:32.121137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1339/2676] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:44:32.125273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:32.135889 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c28b20-f29a-4e08-af5a-f9bdbc310421 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:32.140620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:32.141517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:32.141797 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:32.142073 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] PATH_INFO: `/v3/projects/70efcd9e70b44097810f22b69376e434/users/0ece0415344447689079a2d49bafe51b/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:32.157314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70efcd9e70b44097810f22b69376e434, user_id=0ece0415344447689079a2d49bafe51b, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:32.159995 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:32.282770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1338/2677] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:32 2022] PUT /identity/v3/projects/70efcd9e70b44097810f22b69376e434/users/0ece0415344447689079a2d49bafe51b/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:32.286848 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:32.297031 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bd701-25b9-49de-a0cb-8810494de487 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:32.354808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f79615-3b73-47dd-8403-57132f44a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:32.355581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f79615-3b73-47dd-8403-57132f44a631 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:32.355971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f79615-3b73-47dd-8403-57132f44a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:32.356318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f79615-3b73-47dd-8403-57132f44a631 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:32.357112 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f79615-3b73-47dd-8403-57132f44a631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:32.358882 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f79615-3b73-47dd-8403-57132f44a631 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:32.369445 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1340/2678] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:44:32.373650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:32.384577 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66273306-4140-4431-a812-4ae25931bfdd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:32.389271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:32.390144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:32.390427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:32.390707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] PATH_INFO: `/v3/projects/70efcd9e70b44097810f22b69376e434/users/0ece0415344447689079a2d49bafe51b/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:32.392784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70efcd9e70b44097810f22b69376e434, user_id=0ece0415344447689079a2d49bafe51b, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:32.395408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:32.407361 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1339/2679] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:44:32 2022] PUT /identity/v3/projects/70efcd9e70b44097810f22b69376e434/users/0ece0415344447689079a2d49bafe51b/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:44:38.383335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2b8a-3700-455f-bc67-1d62fcffabaf None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:38.384073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2b8a-3700-455f-bc67-1d62fcffabaf None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:38.384073 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d2b8a-3700-455f-bc67-1d62fcffabaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:38.416182 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-6e3d2b8a-3700-455f-bc67-1d62fcffabaf None None] MFA Rules not processed for user `0ece0415344447689079a2d49bafe51b`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:38.417444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6e3d2b8a-3700-455f-bc67-1d62fcffabaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:38.496373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1341/2680] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:38.509063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:38.511556 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:38.574525 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c1ee-93dc-41b3-b5b2-e1fee2f10ce2 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:38.578282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:38.578959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:38.579247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:38.579526 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:38.638512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:38.640089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:38.650128 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1340/2681] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:44:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:44:38.905543 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03529f7c-621d-4f24-88f6-3508c820f118 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:38.905845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03529f7c-621d-4f24-88f6-3508c820f118 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:38.906132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03529f7c-621d-4f24-88f6-3508c820f118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:38.970845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-03529f7c-621d-4f24-88f6-3508c820f118 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:38.972133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-03529f7c-621d-4f24-88f6-3508c820f118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:39.035770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1342/2682] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:44:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:39.178171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:39.179690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:39.267906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df73b02-7a37-4313-ae86-e042437abcbc service glance] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:39.272952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abb92c-f961-4c77-a32f-729656d39998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:39.273582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abb92c-f961-4c77-a32f-729656d39998 service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:39.273894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abb92c-f961-4c77-a32f-729656d39998 service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:39.274168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abb92c-f961-4c77-a32f-729656d39998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:39.282201 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abb92c-f961-4c77-a32f-729656d39998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:39.283796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abb92c-f961-4c77-a32f-729656d39998 service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:39.292282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1341/2683] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:44:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:44:50.178874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:50.179478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:50.179478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:50.196833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] MFA Rules not processed for user `0984cd81d2274ef1b480eec8584d780f`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:50.198036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:50.204838 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1343/2684] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:44:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:53.400645 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:53.401217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:53.401217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:53.419195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:44:53.420429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:44:53.427741 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1342/2685] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:44:53.440526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:44:53.452240 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45b98-7615-45c0-817d-8e8030c1efa7 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:44:53.457181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:44:53.457833 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:44:53.458118 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:44:53.458391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:44:53.469311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:44:53.470929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:44:53.479503 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1344/2686] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:44:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:45:08.691438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:08.747495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c69d3b-6e50-4b10-a452-541c481408a2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:08.751147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:08.751779 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:08.752185 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:08.752415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:08.754203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:08.821844 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:08.823268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:08.833907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1343/2687] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:11.174180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:11.175681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:11.187721 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108aa03-f017-47f3-8582-91a77848f225 service swift] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:11.191160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:11.191773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:11.192083 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:11.192355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:11.194070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:45:11.206572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:11.207994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:11.218622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1345/2688] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:45:21.973058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:45:21.981806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed47e-dc75-4fb3-ae62-4e68de013e3b service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:45:21.985965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1893-4903-4825-8576-a2da49d1c797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:45:21.986602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1893-4903-4825-8576-a2da49d1c797 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:45:21.986883 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1893-4903-4825-8576-a2da49d1c797 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:45:21.987158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1893-4903-4825-8576-a2da49d1c797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:45:21.997242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1893-4903-4825-8576-a2da49d1c797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:45:21.998653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1893-4903-4825-8576-a2da49d1c797 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:45:22.007978 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1344/2689] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:45:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:07.338490 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:07.339899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:07.403290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3d826-fbfa-45dd-b490-1e1bc1d0faa6 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:07.407133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:07.407784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:07.408745 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:07.408906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:07.410783 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:07.487489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:07.488989 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:07.506366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1346/2690] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:16.890059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaa368-639c-4bcd-b205-0ef4b2e99a3f None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:16.890582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaa368-639c-4bcd-b205-0ef4b2e99a3f None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:16.890693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaa368-639c-4bcd-b205-0ef4b2e99a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:16.908447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-dfdaa368-639c-4bcd-b205-0ef4b2e99a3f None None] MFA Rules not processed for user `7ae637d5f7f941d8b3b3264c786faddc`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:16.909880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-dfdaa368-639c-4bcd-b205-0ef4b2e99a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:16.964988 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1345/2691] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:46:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:29.119724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:29.130851 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:29.150068 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910b94c-c3ef-42c2-9ef0-bfce00b7b800 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:29.165913 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:29.166731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:29.167035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:29.167315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:29.171296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:29.214185 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:29.217192 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:29.243048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1347/2692] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:46:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:46:38.116973 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:38.117468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:38.117592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:38.135802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:46:38.136952 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:38.144054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1346/2693] 10.222.0.91 () {58 vars in 967 bytes} [Mon Feb 21 01:46:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:46:38.184179 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:38.195094 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5d627-3412-46f9-ae44-2ba97fd091b8 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:38.200152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:38.200770 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:38.201048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:38.201320 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:38.209070 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:38.210607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:38.218521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1348/2694] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:46:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:46:46.146596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:46.207471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87d783-d896-4d97-aa7a-8b61941ab168 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:46.212125 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:46.212976 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:46.213276 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:46.213536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] PATH_INFO: `/v3/users/0984cd81d2274ef1b480eec8584d780f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:46.214719 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0984cd81d2274ef1b480eec8584d780f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:46.216932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:46.354020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0984cd81d2274ef1b480eec8584d780f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.355222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0984cd81d2274ef1b480eec8584d780f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.363008 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0984cd81d2274ef1b480eec8584d780f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.377204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0984cd81d2274ef1b480eec8584d780f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.378043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0984cd81d2274ef1b480eec8584d780f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.443030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1347/2695] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:46:46 2022] DELETE /identity/v3/users/0984cd81d2274ef1b480eec8584d780f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:46.667039 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:46.677817 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e69b6f-4a37-4e87-bfe2-392e73cfe0a6 service swift] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:46.734280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:46.735146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:46.735429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:46.735703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] PATH_INFO: `/v3/projects/caf92606a26e43e19b60a51e3eddad9d` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:46.736904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf92606a26e43e19b60a51e3eddad9d)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:46.738780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:46.864748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf92606a26e43e19b60a51e3eddad9d', 'request_id': 'req-31ff2702-159c-4580-a38e-44c0f51bb594'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.869904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf92606a26e43e19b60a51e3eddad9d', 'request_id': 'req-31ff2702-159c-4580-a38e-44c0f51bb594'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.928509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf92606a26e43e19b60a51e3eddad9d', 'request_id': 'req-31ff2702-159c-4580-a38e-44c0f51bb594'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.940174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] The token cache is being invalidate because project caf92606a26e43e19b60a51e3eddad9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:46:46.942552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.942552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:46.942820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1349/2696] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:46:46 2022] DELETE /identity/v3/projects/caf92606a26e43e19b60a51e3eddad9d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:46.947702 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:46.949154 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:46.962807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9039-8903-4934-b523-4861723785ca admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:47.017880 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:47.018744 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:47.019034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:47.019316 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] PATH_INFO: `/v3/users/0ece0415344447689079a2d49bafe51b` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:47.020520 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ece0415344447689079a2d49bafe51b)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:47.022436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:47.159094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ece0415344447689079a2d49bafe51b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.159821 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ece0415344447689079a2d49bafe51b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.166757 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ece0415344447689079a2d49bafe51b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.178275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ece0415344447689079a2d49bafe51b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.179013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ece0415344447689079a2d49bafe51b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.253493 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1348/2697] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:46:46 2022] DELETE /identity/v3/users/0ece0415344447689079a2d49bafe51b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:46:47.518563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:46:47.520004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:46:47.532380 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff2702-159c-4580-a38e-44c0f51bb594 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:46:47.589289 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:46:47.590133 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:46:47.590416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:46:47.590691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] PATH_INFO: `/v3/projects/70efcd9e70b44097810f22b69376e434` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:46:47.592125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70efcd9e70b44097810f22b69376e434)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:46:47.593983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:46:47.705684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70efcd9e70b44097810f22b69376e434', 'request_id': 'req-330c8030-1b15-4377-ac26-8ed38664258d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.711106 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70efcd9e70b44097810f22b69376e434', 'request_id': 'req-330c8030-1b15-4377-ac26-8ed38664258d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.791465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70efcd9e70b44097810f22b69376e434', 'request_id': 'req-330c8030-1b15-4377-ac26-8ed38664258d'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.802402 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] The token cache is being invalidate because project 70efcd9e70b44097810f22b69376e434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:46:47.810967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.810967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:46:47.810967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1350/2698] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:46:47 2022] DELETE /identity/v3/projects/70efcd9e70b44097810f22b69376e434 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:07.551653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:07.553209 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:07.621155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d26f2c-74ac-4902-9714-09759e4adaec admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:07.668819 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:07.669457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:07.669743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:07.670021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:07.671788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:07.734920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:07.736650 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:07.747124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1349/2699] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:11.696948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:11.706802 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:11.728447 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c8030-1b15-4377-ac26-8ed38664258d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:11.736525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:11.738292 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:11.738649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:11.739054 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] PATH_INFO: `/v3/users/5adf4837cc254e1a951dda183d795606` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:11.740584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adf4837cc254e1a951dda183d795606)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:11.744052 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:11.943757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adf4837cc254e1a951dda183d795606'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:11.951806 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adf4837cc254e1a951dda183d795606'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:11.963680 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adf4837cc254e1a951dda183d795606'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:11.965136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adf4837cc254e1a951dda183d795606'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:11.965757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-93b4e7c9-7118-4317-bad8-1b323a915bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adf4837cc254e1a951dda183d795606'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:12.124395 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1351/2700] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:11 2022] DELETE /identity/v3/users/5adf4837cc254e1a951dda183d795606 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:12.365177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:12.377970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f725e-2f50-4c1c-8ba4-6c2b99cb324b service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:12.437568 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:12.438428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:12.438724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:12.439000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] PATH_INFO: `/v3/projects/8ef8a0b8828d4a38a7f8a9465fa9fbaf` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:12.440634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef8a0b8828d4a38a7f8a9465fa9fbaf)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:12.442535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:12.539089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'request_id': 'req-7b7057cb-addd-49a6-9ce7-a652dff03355'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:12.545345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'request_id': 'req-7b7057cb-addd-49a6-9ce7-a652dff03355'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:12.550688 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef8a0b8828d4a38a7f8a9465fa9fbaf', 'request_id': 'req-7b7057cb-addd-49a6-9ce7-a652dff03355'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:12.625268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] The token cache is being invalidate because project 8ef8a0b8828d4a38a7f8a9465fa9fbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:12.625490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:12.626196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-7b7057cb-addd-49a6-9ce7-a652dff03355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:12.627898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1350/2701] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:12 2022] DELETE /identity/v3/projects/8ef8a0b8828d4a38a7f8a9465fa9fbaf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:12.633844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:12.634139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:12.634423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:12.654502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:12.655700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:12.712361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1352/2702] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:12.720697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:12.720989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:12.721271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:12.739358 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:12.740582 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:12.749518 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1351/2703] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:12.753771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:12.764188 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39207dfe-f1fb-4fab-8d25-9b142e00e013 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:12.768724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:12.769366 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:12.769651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:12.769931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:12.770649 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:12.770959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:12.772604 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:12.784077 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1353/2704] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:12.788222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:12.797815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6eebe-55a3-4a3c-9bf0-27d1575458e9 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:12.802512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:12.803148 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:12.803429 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:12.803707 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:12.804426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:12.806330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:12.895927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1352/2705] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:12 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:12.900095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:12.911764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0249-257d-45cd-af40-6c75e11d4512 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:12.968525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:12.969189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:12.969484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:12.969762 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:12.970458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:12.972422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.107009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1354/2706] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:12 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:13.111132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.122087 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5a37-5a02-4db0-8661-c533a77d0c3a admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.126953 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.127634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.128146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.128431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.129196 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.130856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.142193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1353/2707] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:13.146223 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.156459 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91eb65-0de0-4731-82ee-b79cf55c3205 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.161174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc245d23-3ecf-4823-905b-75dbdb451409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.161826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc245d23-3ecf-4823-905b-75dbdb451409 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.162147 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc245d23-3ecf-4823-905b-75dbdb451409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.162394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc245d23-3ecf-4823-905b-75dbdb451409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.163142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc245d23-3ecf-4823-905b-75dbdb451409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.164750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc245d23-3ecf-4823-905b-75dbdb451409 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.175256 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1355/2708] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:13.179468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.189738 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcaef5-32ab-447c-82c7-215157e89911 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.194259 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.196423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.196423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.196423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] PATH_INFO: `/v3/projects/544a5195bc694788bf2853734b4072e3/users/6a4be94be91745c288921418cd5298c0/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.209729 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=544a5195bc694788bf2853734b4072e3, user_id=6a4be94be91745c288921418cd5298c0, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.212370 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.295134 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1354/2709] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:13 2022] PUT /identity/v3/projects/544a5195bc694788bf2853734b4072e3/users/6a4be94be91745c288921418cd5298c0/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:13.305976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.306269 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.306548 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.332651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] MFA Rules not processed for user `6a4be94be91745c288921418cd5298c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:13.333842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:13.397462 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1356/2710] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:13.402404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.462704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730514b-1bc8-4995-802b-ccb4ceb04dad admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.468442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.469096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.469377 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.469657 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.470374 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.472510 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.591786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1355/2711] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:13 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:13.593364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.603784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e2d34-b310-44a0-8e18-453870294662 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.658235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.658898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.659190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.663297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.663297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.663297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.753048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1357/2712] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:13 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:13.756828 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.769471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663c741-4c8d-4d0d-9a8e-c83e900c8e5e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.773683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.774351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.774641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.774923 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.775656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.777273 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.788866 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1356/2713] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:13.793161 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.803436 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00916cc6-d7c7-4b02-bd5f-4aa9ac042ffe admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.808214 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.809703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.809985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.810262 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] PATH_INFO: `/v3/projects/806fe80c8085445088d07a37606c33dd/users/d6e20c0e11814f159d01de0d6cbe4acb/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.824733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806fe80c8085445088d07a37606c33dd, user_id=d6e20c0e11814f159d01de0d6cbe4acb, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.827350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.889124 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1358/2714] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:13 2022] PUT /identity/v3/projects/806fe80c8085445088d07a37606c33dd/users/d6e20c0e11814f159d01de0d6cbe4acb/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:13.893138 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.903632 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d7780-1b8e-4f87-a22c-0b332d7f4ef5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.958446 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471880f-bda2-4639-803a-a5020d1ab253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.959021 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471880f-bda2-4639-803a-a5020d1ab253 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.959302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471880f-bda2-4639-803a-a5020d1ab253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.959601 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471880f-bda2-4639-803a-a5020d1ab253 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.960384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471880f-bda2-4639-803a-a5020d1ab253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:13.962324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471880f-bda2-4639-803a-a5020d1ab253 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:13.974479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1357/2715] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:13.978440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:13.989644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d491948-4dce-45c5-9697-5442430d3077 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:13.994349 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:13.995216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:13.995497 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:13.995773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] PATH_INFO: `/v3/projects/806fe80c8085445088d07a37606c33dd/users/d6e20c0e11814f159d01de0d6cbe4acb/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:13.997786 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806fe80c8085445088d07a37606c33dd, user_id=d6e20c0e11814f159d01de0d6cbe4acb, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:14.002132 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:14.010999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1359/2716] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:13 2022] PUT /identity/v3/projects/806fe80c8085445088d07a37606c33dd/users/d6e20c0e11814f159d01de0d6cbe4acb/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:14.021280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:14.026420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:14.026420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:14.049329 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] MFA Rules not processed for user `d6e20c0e11814f159d01de0d6cbe4acb`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:14.050521 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:14.116533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1358/2717] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:14.126768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:14.128487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:14.183890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25f609-c9d0-4dbf-a890-6a2bc5bac1f5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:14.187777 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:14.188435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:14.188720 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:14.189004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:14.198000 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:14.199446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:14.209058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1360/2718] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:14.303602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:14.305035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:14.316957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9c602-94da-459b-9861-9c498b88dbc0 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:14.320685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabee2b3-5bb7-4843-aed3-e8ad55d46586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:14.321321 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabee2b3-5bb7-4843-aed3-e8ad55d46586 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:14.321610 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabee2b3-5bb7-4843-aed3-e8ad55d46586 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:14.321911 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabee2b3-5bb7-4843-aed3-e8ad55d46586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:14.379396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabee2b3-5bb7-4843-aed3-e8ad55d46586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:14.380926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabee2b3-5bb7-4843-aed3-e8ad55d46586 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:14.390103 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1359/2719] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:19.114441 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:19.177335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58ff15-8b9c-418b-815b-1254427fd1d2 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:19.183590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:19.183590 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:19.184279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:19.184514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] PATH_INFO: `/v3/users/6a4be94be91745c288921418cd5298c0` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:19.185705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4be94be91745c288921418cd5298c0)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:19.187610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:19.389988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4be94be91745c288921418cd5298c0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:19.396916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4be94be91745c288921418cd5298c0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:19.408667 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4be94be91745c288921418cd5298c0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:19.409502 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4be94be91745c288921418cd5298c0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:19.410180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4be94be91745c288921418cd5298c0'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:19.477893 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1361/2720] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:19 2022] DELETE /identity/v3/users/6a4be94be91745c288921418cd5298c0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:19.483151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:19.483679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:19.483679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:19.503412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:19.504962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:19.567602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1360/2721] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:19.577694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:19.579444 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:19.638480 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac9841-26cd-4cd0-80ef-6f16e6d3c1c8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:19.642753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:19.643507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:19.643919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:19.644294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:19.654511 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:19.656251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:19.667283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1362/2722] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:20.237837 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:20.239297 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:20.251770 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355d31-339e-46a9-808d-2b8797f715ec None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:20.256565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:20.257417 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:20.257703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:20.257983 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] PATH_INFO: `/v3/projects/544a5195bc694788bf2853734b4072e3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:20.259173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] RBAC: Authorizing `identity:delete_project(project_id=544a5195bc694788bf2853734b4072e3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:20.261111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:20.365177 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544a5195bc694788bf2853734b4072e3', 'request_id': 'req-521640cf-9b83-42a5-8fb3-b920b27b585b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.371421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544a5195bc694788bf2853734b4072e3', 'request_id': 'req-521640cf-9b83-42a5-8fb3-b920b27b585b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.377023 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544a5195bc694788bf2853734b4072e3', 'request_id': 'req-521640cf-9b83-42a5-8fb3-b920b27b585b'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.427905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] The token cache is being invalidate because project 544a5195bc694788bf2853734b4072e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:20.428599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.429561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.436203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:20.437238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1361/2723] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:20 2022] DELETE /identity/v3/projects/544a5195bc694788bf2853734b4072e3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:20.454759 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fe27-e205-4f69-b353-67c7e42ba3a0 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:20.522333 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:20.523288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:20.523636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:20.524024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] PATH_INFO: `/v3/users/d6e20c0e11814f159d01de0d6cbe4acb` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:20.525297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e20c0e11814f159d01de0d6cbe4acb)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:20.527457 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:20.739304 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e20c0e11814f159d01de0d6cbe4acb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.751690 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e20c0e11814f159d01de0d6cbe4acb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.764270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e20c0e11814f159d01de0d6cbe4acb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.765036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e20c0e11814f159d01de0d6cbe4acb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.765876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e20c0e11814f159d01de0d6cbe4acb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:20.832656 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1363/2724] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:20 2022] DELETE /identity/v3/users/d6e20c0e11814f159d01de0d6cbe4acb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:21.468897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:21.470423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:21.491998 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521640cf-9b83-42a5-8fb3-b920b27b585b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:21.496896 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:21.499296 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:21.556460 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:21.557323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:21.557609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:21.557888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] PATH_INFO: `/v3/projects/806fe80c8085445088d07a37606c33dd` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:21.559968 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806fe80c8085445088d07a37606c33dd)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:21.561566 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:21.565587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261981e-2af1-44d7-ad0e-08c6ee9ace11 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:21.570172 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:21.571654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:21.571654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:21.571654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] PATH_INFO: `/v3/users/7ae637d5f7f941d8b3b3264c786faddc` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:21.572814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae637d5f7f941d8b3b3264c786faddc)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:21.575297 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:21.665338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806fe80c8085445088d07a37606c33dd', 'request_id': 'req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.671745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806fe80c8085445088d07a37606c33dd', 'request_id': 'req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.677076 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806fe80c8085445088d07a37606c33dd', 'request_id': 'req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.770694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae637d5f7f941d8b3b3264c786faddc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.774071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] The token cache is being invalidate because project 806fe80c8085445088d07a37606c33dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:21.774398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.775005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-0dabd302-a80a-46a4-bf89-cd0d6685e9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.780762 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1362/2725] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:21 2022] DELETE /identity/v3/projects/806fe80c8085445088d07a37606c33dd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:21.780892 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae637d5f7f941d8b3b3264c786faddc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.782225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:21.782511 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:21.782788 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:21.789834 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae637d5f7f941d8b3b3264c786faddc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.790558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae637d5f7f941d8b3b3264c786faddc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.791198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-eb35644b-c1e7-49a8-b5c0-14b04cabb173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae637d5f7f941d8b3b3264c786faddc'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:21.800602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:21.801786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:21.848682 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1364/2726] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:21 2022] DELETE /identity/v3/users/7ae637d5f7f941d8b3b3264c786faddc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:21.862643 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1363/2727] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:21.870337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:21.870628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:21.870916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:21.888846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:21.890050 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:21.948742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1365/2728] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:21.954143 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:21.963700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9db55f-7888-4a4d-8fe6-ff2ce26da97b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:21.970111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:21.970799 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:21.971278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:21.971706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:21.972480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:21.972842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:21.974448 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:21.986678 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1364/2729] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:21.991189 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.000552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df993ad-4932-4688-b06a-d28d6069d95a None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.005390 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.009374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.009374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.009374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.009374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.009374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.085020 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.086793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:22.101703 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df19397-fdae-48b5-a0a4-780ef071c068 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.107634 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.108536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.108801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.109158 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] PATH_INFO: `/v3/projects/40d1276aa84a48ab830165304f9d6f74` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.110457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d1276aa84a48ab830165304f9d6f74)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.112232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.114872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1366/2730] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:21 2022] POST /identity/v3/projects => generated 397 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:22.118880 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.183456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe0d1b-b8d8-4419-a49e-b4067faf65d7 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.190453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.191110 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.191392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.191662 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.192386 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.194309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.215034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d1276aa84a48ab830165304f9d6f74', 'request_id': 'req-04d7109c-d244-40a1-89c3-e12c580a90f5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:22.222032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d1276aa84a48ab830165304f9d6f74', 'request_id': 'req-04d7109c-d244-40a1-89c3-e12c580a90f5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:22.227323 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d1276aa84a48ab830165304f9d6f74', 'request_id': 'req-04d7109c-d244-40a1-89c3-e12c580a90f5'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:22.272142 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1367/2731] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:22.276252 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.285683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f29334-9217-4916-b823-5586ea0a897d admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.299918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] The token cache is being invalidate because project 40d1276aa84a48ab830165304f9d6f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:22.300213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:22.300854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-04d7109c-d244-40a1-89c3-e12c580a90f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:22.302855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1365/2732] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:22 2022] DELETE /identity/v3/projects/40d1276aa84a48ab830165304f9d6f74 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:22.308567 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.309409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.309891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.327862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:22.329079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:22.341409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.342336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.342622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.342903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.343633 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.345282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.355816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1368/2733] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:22.359791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.362609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:22.375552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea499b-9912-4581-af3c-148bf40d57bf admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.381116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3254bda-6086-40f5-8627-ab30d48c8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.381776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254bda-6086-40f5-8627-ab30d48c8c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.382063 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254bda-6086-40f5-8627-ab30d48c8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.382396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3254bda-6086-40f5-8627-ab30d48c8c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.383123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254bda-6086-40f5-8627-ab30d48c8c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.384766 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3254bda-6086-40f5-8627-ab30d48c8c05 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.394625 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1366/2734] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:22.399313 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1369/2735] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:22.400802 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.402664 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.403350 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.403814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.410543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abfefc-21a1-42f3-ae04-2c30c59f921b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.418105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d878db-d865-4478-86b1-61b22285ee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.419095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d878db-d865-4478-86b1-61b22285ee3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.419583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d878db-d865-4478-86b1-61b22285ee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.419583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d878db-d865-4478-86b1-61b22285ee3d admin admin] PATH_INFO: `/v3/projects/723340d4f48c401cb5af15d5c3ae2104/users/dbec27afdb2b4bfea0abb1eb4a998967/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.424198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:22.425427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:22.433396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1370/2736] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:22.438035 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.438282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d878db-d865-4478-86b1-61b22285ee3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=723340d4f48c401cb5af15d5c3ae2104, user_id=dbec27afdb2b4bfea0abb1eb4a998967, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.441029 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d878db-d865-4478-86b1-61b22285ee3d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.447141 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92b644-0609-4178-96e3-7e9ad261bed2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.452644 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.453283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.453597 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.459526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.459526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:22.459526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.459526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.468114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1371/2737] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:47:22.472293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.481634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00474b-fe36-45e9-ab5f-ecaf66749482 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.486244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.486850 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.487135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.487466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.488140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.489966 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.535118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1367/2738] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:22 2022] PUT /identity/v3/projects/723340d4f48c401cb5af15d5c3ae2104/users/dbec27afdb2b4bfea0abb1eb4a998967/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:22.547090 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.547385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.547669 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.568769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1372/2739] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:22.570293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.574624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] MFA Rules not processed for user `dbec27afdb2b4bfea0abb1eb4a998967`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:22.576022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:22.630988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af856-36cb-4ffd-9dad-b32e524159c6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.635717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.636416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.636702 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.637001 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.637771 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.638238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1368/2740] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:22.641336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.642687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.652915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70945279-73bc-4299-b699-edb4b0d0cad6 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.657682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.660324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.660324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.660324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.660324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.661469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.735517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1373/2741] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:22.739435 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.749570 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c1f19-93d4-4dc1-8987-eceb68b6f5af admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.754191 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.754829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.755115 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.755396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.756163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.757743 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.759407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1369/2742] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:22.769072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1374/2743] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:22.771555 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.772646 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.782315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932fc47-ed25-48bf-8d3d-4fb7f02a41ca admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.831918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6655-f03b-4a61-8d5b-0bab82ad8c17 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.836609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.837135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.837272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.837529 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.837787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.837877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.838071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.838347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.838487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.839066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.840468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.841098 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.850842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1375/2744] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:22.854888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.864707 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d53df-74d8-4d4c-8e7c-e8492a1763a0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.869243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8955f9-0d65-461d-bf2e-b97f16666a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.870079 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8955f9-0d65-461d-bf2e-b97f16666a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.870360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8955f9-0d65-461d-bf2e-b97f16666a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.870630 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8955f9-0d65-461d-bf2e-b97f16666a91 admin admin] PATH_INFO: `/v3/projects/9cd114e968ce4e509096feccbe285df1/users/be7ac9419e1545edacdfb1a1b45e7dcb/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.885510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8955f9-0d65-461d-bf2e-b97f16666a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd114e968ce4e509096feccbe285df1, user_id=be7ac9419e1545edacdfb1a1b45e7dcb, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.888494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8955f9-0d65-461d-bf2e-b97f16666a91 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.900679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1370/2745] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/users => generated 305 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:22.905157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.914640 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588af32-00b2-4ce5-b38a-ea0371217258 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.920283 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:22.920919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.921205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.921482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.922199 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:22.923772 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:22.933894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1371/2746] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:22.938456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:22.946090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1376/2747] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:22 2022] PUT /identity/v3/projects/9cd114e968ce4e509096feccbe285df1/users/be7ac9419e1545edacdfb1a1b45e7dcb/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:22.947756 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f63b07-d37b-4c9f-bd1d-b1a13c6c28a7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:22.956479 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:22.956948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:22.957227 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:22.985847 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] MFA Rules not processed for user `be7ac9419e1545edacdfb1a1b45e7dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:22.986965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:23.006136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:23.007024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.007315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.007628 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] PATH_INFO: `/v3/projects/53417326134f440cb5f70c0363727c66/users/b29b69c651d04b6b936271472baec628/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.023320 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53417326134f440cb5f70c0363727c66, user_id=b29b69c651d04b6b936271472baec628, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:23.026091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:23.050477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1377/2748] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:23.061612 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:23.062967 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:23.132686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd0a5f-9e42-47b8-99e5-b31b6d4c3ee0 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:23.138642 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:23.139287 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.139573 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.139876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.140924 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1372/2749] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:22 2022] PUT /identity/v3/projects/53417326134f440cb5f70c0363727c66/users/b29b69c651d04b6b936271472baec628/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:23.144881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:23.147961 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:23.149541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:23.159209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1378/2750] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:23.338778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2b739-e4be-42c6-9c67-fd73e372c88e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:23.344369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d772a8-6082-46d0-b2d3-3df481aa0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:23.345025 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d772a8-6082-46d0-b2d3-3df481aa0411 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.345308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d772a8-6082-46d0-b2d3-3df481aa0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.345584 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d772a8-6082-46d0-b2d3-3df481aa0411 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.346314 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d772a8-6082-46d0-b2d3-3df481aa0411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:23.347914 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d772a8-6082-46d0-b2d3-3df481aa0411 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:23.357946 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1373/2751] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:23.362095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:23.372466 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c3a1c-cdda-4fc8-972d-58ac202b06c0 service nova] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:23.377246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:23.378097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.378377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.378650 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] PATH_INFO: `/v3/projects/53417326134f440cb5f70c0363727c66/users/b29b69c651d04b6b936271472baec628/roles/30d31529b5824c178844aea14bad4358` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.380605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53417326134f440cb5f70c0363727c66, user_id=b29b69c651d04b6b936271472baec628, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:23.383178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:23.394239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1379/2752] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:23 2022] PUT /identity/v3/projects/53417326134f440cb5f70c0363727c66/users/b29b69c651d04b6b936271472baec628/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:23.405086 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.405438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.405723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.431208 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] MFA Rules not processed for user `b29b69c651d04b6b936271472baec628`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:23.432427 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:23.498406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1374/2753] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:23.507677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:23.509378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:23.565373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb96a149-7955-4930-882c-01311366d187 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:23.569048 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:23.569683 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.569966 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.570265 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.580260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:23.581717 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:23.592137 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1380/2754] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:23.768699 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:23.778698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e5be-9ebc-4bd9-a9b3-5dea73ebb2aa None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:23.782932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310dc76-f9e3-4b9c-bf2d-9752e5c38f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:23.783565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310dc76-f9e3-4b9c-bf2d-9752e5c38f48 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:23.783855 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310dc76-f9e3-4b9c-bf2d-9752e5c38f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:23.784153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310dc76-f9e3-4b9c-bf2d-9752e5c38f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:23.841397 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310dc76-f9e3-4b9c-bf2d-9752e5c38f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:23.843091 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310dc76-f9e3-4b9c-bf2d-9752e5c38f48 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:23.852110 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1375/2755] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:29.569541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.631140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8be4f3-7ddc-47e0-9505-78a04c429548 service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:29.635776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:29.636665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.637565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.638074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] PATH_INFO: `/v3/users/dbec27afdb2b4bfea0abb1eb4a998967` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.639340 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbec27afdb2b4bfea0abb1eb4a998967)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:29.641272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:29.768307 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbec27afdb2b4bfea0abb1eb4a998967'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.775398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbec27afdb2b4bfea0abb1eb4a998967'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.787089 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbec27afdb2b4bfea0abb1eb4a998967'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.787797 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbec27afdb2b4bfea0abb1eb4a998967'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.788426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbec27afdb2b4bfea0abb1eb4a998967'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:29.854314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1381/2756] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:29 2022] DELETE /identity/v3/users/dbec27afdb2b4bfea0abb1eb4a998967 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:29.864921 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:29.865396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:29.865482 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:29.885795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:29.887591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:29.944836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1376/2757] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:29.955508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:29.956999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:30.013509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e396e36-4f60-4dab-aa35-3e4cac7f2c54 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.017283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.017931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.018212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.018487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.027971 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.029504 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.038769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1382/2758] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:30.415944 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:30.418915 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:30.429850 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283e757-4f19-4f23-bea6-6831940100aa None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.435441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.436553 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.436839 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.437118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] PATH_INFO: `/v3/projects/723340d4f48c401cb5af15d5c3ae2104` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.438351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723340d4f48c401cb5af15d5c3ae2104)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.441018 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.586647 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723340d4f48c401cb5af15d5c3ae2104', 'request_id': 'req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.594193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723340d4f48c401cb5af15d5c3ae2104', 'request_id': 'req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.599573 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723340d4f48c401cb5af15d5c3ae2104', 'request_id': 'req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.682785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] The token cache is being invalidate because project 723340d4f48c401cb5af15d5c3ae2104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:30.683011 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.683635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.685251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1377/2759] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:30 2022] DELETE /identity/v3/projects/723340d4f48c401cb5af15d5c3ae2104 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:30.691737 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:30.698768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9323ba-bfcf-4265-913a-1ff556ee16c3 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:30.753976 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:30.754830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:30.755119 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:30.755396 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] PATH_INFO: `/v3/users/b29b69c651d04b6b936271472baec628` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:30.756596 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29b69c651d04b6b936271472baec628)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:30.758525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:30.971338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29b69c651d04b6b936271472baec628'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.978088 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29b69c651d04b6b936271472baec628'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.989753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29b69c651d04b6b936271472baec628'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.990433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29b69c651d04b6b936271472baec628'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:30.991071 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c1dc393b-b33c-4f4e-844f-50aa016e25fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29b69c651d04b6b936271472baec628'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.066358 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1383/2760] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:30 2022] DELETE /identity/v3/users/b29b69c651d04b6b936271472baec628 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:31.434406 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.436269 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.450575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44472-3aa4-4ba8-92dc-4d7ae74e6146 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.508818 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.509671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.509958 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.510238 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] PATH_INFO: `/v3/projects/53417326134f440cb5f70c0363727c66` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.511453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53417326134f440cb5f70c0363727c66)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.514449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.621059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53417326134f440cb5f70c0363727c66', 'request_id': 'req-409afb40-29fa-4c42-bc29-4d1ae8ca5310'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.627620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53417326134f440cb5f70c0363727c66', 'request_id': 'req-409afb40-29fa-4c42-bc29-4d1ae8ca5310'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.632784 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53417326134f440cb5f70c0363727c66', 'request_id': 'req-409afb40-29fa-4c42-bc29-4d1ae8ca5310'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.694333 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] The token cache is being invalidate because project 53417326134f440cb5f70c0363727c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:31.694624 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.695251 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-409afb40-29fa-4c42-bc29-4d1ae8ca5310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:31.696885 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1378/2761] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:31 2022] DELETE /identity/v3/projects/53417326134f440cb5f70c0363727c66 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:31.701816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.702264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.702372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.719569 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:31.720791 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.778090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1384/2762] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:31.787034 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.787326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.787639 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.806089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:31.807271 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:31.815937 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1379/2763] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:31.865816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.876012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428d1c-fa33-4919-8ef8-df6b1d1c8b45 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.880593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.881238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.881516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.881814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.882558 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:31.882860 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.884579 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.896012 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1385/2764] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:31.900528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:31.910348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a8374-4c4b-4e7c-a6d3-6e7dc6ebdfbd None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:31.915124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:31.915870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:31.916169 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:31.916524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:31.917212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:31.919927 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:31.998906 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1380/2765] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:31 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:32.002943 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.013005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca8ee3-7eb5-4f43-bc12-fe351b63e6f4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.066901 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.067553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.067898 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.068183 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.068883 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.070779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.169131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1386/2766] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:32.173771 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.187089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979f050-1bfd-464e-932c-b4994c130560 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.192407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.193115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.193390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.193671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.194414 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.196268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.207917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1381/2767] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.212283 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.222930 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af4f9f-8e75-4013-880b-c94bd5d480a5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.227742 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.228519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.228874 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.229222 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.230085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.233844 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.246959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1387/2768] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.248292 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.258348 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307aef47-e2bf-4483-a5be-b3abf2c708e1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.262964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494111e4-f8d9-44a0-b184-581dcaf6087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.264360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494111e4-f8d9-44a0-b184-581dcaf6087c admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.264641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494111e4-f8d9-44a0-b184-581dcaf6087c admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.264920 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494111e4-f8d9-44a0-b184-581dcaf6087c admin admin] PATH_INFO: `/v3/projects/49bded6093e04224b8dbbe69d0e4406b/users/26201b29a91540fa9410b15df6776122/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.276034 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.277716 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.281536 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494111e4-f8d9-44a0-b184-581dcaf6087c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bded6093e04224b8dbbe69d0e4406b, user_id=26201b29a91540fa9410b15df6776122, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.284224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494111e4-f8d9-44a0-b184-581dcaf6087c admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.291322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4037c2-0c71-43da-a988-255240491383 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.296201 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.297053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.297336 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.297641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] PATH_INFO: `/v3/users/be7ac9419e1545edacdfb1a1b45e7dcb` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.298839 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7ac9419e1545edacdfb1a1b45e7dcb)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.300769 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.393067 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1382/2769] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:32 2022] PUT /identity/v3/projects/49bded6093e04224b8dbbe69d0e4406b/users/26201b29a91540fa9410b15df6776122/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:32.402815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.403114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.403392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.429217 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] MFA Rules not processed for user `26201b29a91540fa9410b15df6776122`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:32.430443 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.488074 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7ac9419e1545edacdfb1a1b45e7dcb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:32.492766 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1383/2770] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:32.496547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7ac9419e1545edacdfb1a1b45e7dcb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:32.496836 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.508465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7ac9419e1545edacdfb1a1b45e7dcb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:32.509135 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7ac9419e1545edacdfb1a1b45e7dcb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:32.509830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-2faab0d1-958a-4f6e-aacf-ffe6cb4fc769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7ac9419e1545edacdfb1a1b45e7dcb'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:32.559815 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33ca58-f050-4fc7-a43c-fc5bde7c4bb4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.564551 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.565204 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.565486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.565798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.566450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.568357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.580545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1388/2771] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:32 2022] DELETE /identity/v3/users/be7ac9419e1545edacdfb1a1b45e7dcb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:32.584940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.585302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.585591 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.603660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:32.604865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.663374 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1389/2772] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:32.673116 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.675942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1384/2773] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:32.676879 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.677813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.679706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:32.734154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a0057-3d3b-4c21-be17-67e7800eed26 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.741989 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d8a1e-0b11-4ddb-be84-1bc4ecbb3599 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.746671 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.747326 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.747607 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.748548 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.749248 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.751142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.782306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.782876 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.783146 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.783425 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.792572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.793982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.803605 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1390/2774] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:32.844709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1385/2775] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:32 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:32.848583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.858144 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c147a8-699e-4827-ae4e-7baf145a80eb service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.863397 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.866180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.866180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.866180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.866180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.866986 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.877906 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1391/2776] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:32.882186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:32.892987 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f761-6a2f-4b73-af24-ed69b327dbf5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:32.897876 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:32.898888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:32.899410 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:32.899807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] PATH_INFO: `/v3/projects/c89e0a01414f437ab1e568838fa2f955/users/8e58b0e9cbda4421a9e616bff5259667/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:32.914683 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89e0a01414f437ab1e568838fa2f955, user_id=8e58b0e9cbda4421a9e616bff5259667, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:32.917317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:32.990262 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1386/2777] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:32 2022] PUT /identity/v3/projects/c89e0a01414f437ab1e568838fa2f955/users/8e58b0e9cbda4421a9e616bff5259667/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:32.994011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.005440 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dceccf-98e4-4a02-9856-abc150246ca0 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.068651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13a81b-cb16-40ed-8471-68dacfe3242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.069331 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13a81b-cb16-40ed-8471-68dacfe3242b admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.069622 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13a81b-cb16-40ed-8471-68dacfe3242b admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.069903 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13a81b-cb16-40ed-8471-68dacfe3242b admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.070681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13a81b-cb16-40ed-8471-68dacfe3242b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.072345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13a81b-cb16-40ed-8471-68dacfe3242b admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.083291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1392/2778] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:33.087561 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.099162 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a62b60-a003-45aa-b169-0e4591b5e23d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.103994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.104869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.105203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.105483 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] PATH_INFO: `/v3/projects/c89e0a01414f437ab1e568838fa2f955/users/8e58b0e9cbda4421a9e616bff5259667/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.108469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89e0a01414f437ab1e568838fa2f955, user_id=8e58b0e9cbda4421a9e616bff5259667, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.111203 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.122188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1387/2779] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:33 2022] PUT /identity/v3/projects/c89e0a01414f437ab1e568838fa2f955/users/8e58b0e9cbda4421a9e616bff5259667/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:33.144282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.144673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.144988 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.171601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] MFA Rules not processed for user `8e58b0e9cbda4421a9e616bff5259667`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:33.172846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:33.238385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1393/2780] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:33.250415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.252235 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:33.273574 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.275163 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:33.315501 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2ad63-06a9-40cb-ae22-2909b4456ffd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.319800 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.320514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.320785 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.321064 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.332264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.333993 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.345114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1388/2781] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:33.349614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0efd3a-c652-42b0-b024-52e587431631 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.355434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.356495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.356887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.357862 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] PATH_INFO: `/v3/projects/9cd114e968ce4e509096feccbe285df1` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.359586 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd114e968ce4e509096feccbe285df1)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.361584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.486356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd114e968ce4e509096feccbe285df1', 'request_id': 'req-4893f948-327b-4825-a627-5c4e6039b2b6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:33.491750 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd114e968ce4e509096feccbe285df1', 'request_id': 'req-4893f948-327b-4825-a627-5c4e6039b2b6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:33.583782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.595325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd114e968ce4e509096feccbe285df1', 'request_id': 'req-4893f948-327b-4825-a627-5c4e6039b2b6'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:33.595442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e374-2472-4c8f-8e85-07a719b309be service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.603407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] The token cache is being invalidate because project 9cd114e968ce4e509096feccbe285df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:33.603694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:33.604368 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-4893f948-327b-4825-a627-5c4e6039b2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:33.605932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1394/2782] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:33 2022] DELETE /identity/v3/projects/9cd114e968ce4e509096feccbe285df1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:33.611276 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee5340-46e3-477e-ac82-bf8d02d6d761 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.611645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee5340-46e3-477e-ac82-bf8d02d6d761 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.611963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee5340-46e3-477e-ac82-bf8d02d6d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.630904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8aee5340-46e3-477e-ac82-bf8d02d6d761 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:33.632123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8aee5340-46e3-477e-ac82-bf8d02d6d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:33.643743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.644416 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.644740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.645022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.646814 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:33.690494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1395/2783] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:33.698517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.698814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.699097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.705480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.706905 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.715810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1389/2784] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:33.719494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:33.720775 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:33.729158 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1396/2785] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:33.734856 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.745824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31a807-3e43-44e3-9d8b-96cd342e2be6 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.750480 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.751151 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.751435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.751711 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.752487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:33.752792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.754364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.766954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1390/2786] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:33.771369 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.781228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f036cb-4ee1-4069-87e1-f6a232073361 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.786452 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.787208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.787494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.787796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.788542 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.790477 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:33.862059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1397/2787] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:33 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:33.866282 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:33.876398 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343b958-e6aa-405e-9a97-2b81c7a06f2d admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:33.933665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:33.934453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:33.934743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:33.935085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:33.935965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:33.937949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.020509 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1391/2788] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:33 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:34.024842 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.035824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20fa73-bee6-4801-8c01-c02b1181630a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.040694 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.041346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.041626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.041897 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.042660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.044288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.054888 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1398/2789] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:34.059117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.068925 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44689-1fe1-4afa-9fa1-8f61990502bb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.073687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff3ff-3a8b-4ebd-bdce-c040031893f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.074338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff3ff-3a8b-4ebd-bdce-c040031893f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.074616 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff3ff-3a8b-4ebd-bdce-c040031893f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.074902 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff3ff-3a8b-4ebd-bdce-c040031893f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.075651 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aff3ff-3a8b-4ebd-bdce-c040031893f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.077776 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aff3ff-3a8b-4ebd-bdce-c040031893f4 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.088179 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1392/2790] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:34.093306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.103516 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8166b-4c6c-4b83-b18d-3e9bc7b400c2 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.108282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.109149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.109429 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.109703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] PATH_INFO: `/v3/projects/abb863b1a8b843dc9a32fc54bfce8eb6/users/b25246a08cee439ea436f02d4039bb30/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.125293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb863b1a8b843dc9a32fc54bfce8eb6, user_id=b25246a08cee439ea436f02d4039bb30, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.127935 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.187100 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1399/2791] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:34 2022] PUT /identity/v3/projects/abb863b1a8b843dc9a32fc54bfce8eb6/users/b25246a08cee439ea436f02d4039bb30/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:34.198599 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.198898 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.199182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.225847 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] MFA Rules not processed for user `b25246a08cee439ea436f02d4039bb30`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:34.227093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:34.296728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1393/2792] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:34.301080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.367673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2cb74-29af-4535-b06b-1190c07d8b9a admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.372632 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.374080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.374372 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.374652 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.376392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.377279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.457531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1400/2793] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:34 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:34.461572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.472580 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9f21-656b-4faf-95b4-4bdc22d98f1b None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.531712 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.532413 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.532700 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.533003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.533693 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.535663 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.609581 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1394/2794] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:34 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:34.613547 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.624268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e881-7430-47cd-8447-a109881f8357 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.633859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.633859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.633859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.633859 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.634200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.634200 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.642889 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1401/2795] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:34.646774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.656825 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe490fe4-38b4-4ba3-9fc4-9c40f9b5d7b6 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.661464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.662595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.662595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.662842 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] PATH_INFO: `/v3/projects/2adc415f95e0421abdd6478e78309d4e/users/369dac72b1e44e149d334d4d6d1f92c5/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.677272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adc415f95e0421abdd6478e78309d4e, user_id=369dac72b1e44e149d334d4d6d1f92c5, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.679903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.752899 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1395/2796] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:34 2022] PUT /identity/v3/projects/2adc415f95e0421abdd6478e78309d4e/users/369dac72b1e44e149d334d4d6d1f92c5/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:34.756891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.766470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d89cf0-0b13-4f36-91b9-4e2b92102c96 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.821325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e8d09-573b-465b-afa1-1ad7b95ef781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.821992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e8d09-573b-465b-afa1-1ad7b95ef781 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.822247 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e8d09-573b-465b-afa1-1ad7b95ef781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.822526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e8d09-573b-465b-afa1-1ad7b95ef781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.823246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e8d09-573b-465b-afa1-1ad7b95ef781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.824843 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e8d09-573b-465b-afa1-1ad7b95ef781 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.834204 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1402/2797] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:34.838384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.849157 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530999f-f32a-4f18-aeac-bdba3fce81b7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:34.853708 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:34.854562 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.854839 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.855111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] PATH_INFO: `/v3/projects/2adc415f95e0421abdd6478e78309d4e/users/369dac72b1e44e149d334d4d6d1f92c5/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.857096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adc415f95e0421abdd6478e78309d4e, user_id=369dac72b1e44e149d334d4d6d1f92c5, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:34.860294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:34.870144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1396/2798] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:34 2022] PUT /identity/v3/projects/2adc415f95e0421abdd6478e78309d4e/users/369dac72b1e44e149d334d4d6d1f92c5/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:34.883341 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:34.883730 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:34.884335 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:34.912160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] MFA Rules not processed for user `369dac72b1e44e149d334d4d6d1f92c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:34.913342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:34.979675 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1403/2799] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:34.990621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:34.992330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:35.051715 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7deaf6-c3c5-4ff6-8979-5a88c2c4c798 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.055404 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.056083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.056369 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.056649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.065758 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.067173 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.076959 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1397/2800] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:35.253408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:35.262907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2fce5-2263-4ee5-8194-00f1b7c9e423 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:35.266992 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542b20c-f5a2-445a-87fe-700abafe9bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:35.267625 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542b20c-f5a2-445a-87fe-700abafe9bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:35.267947 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542b20c-f5a2-445a-87fe-700abafe9bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:35.268226 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542b20c-f5a2-445a-87fe-700abafe9bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:35.322757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542b20c-f5a2-445a-87fe-700abafe9bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:35.324213 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542b20c-f5a2-445a-87fe-700abafe9bf9 service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:35.333572 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1404/2801] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:39.828106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:39.829569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:39.892280 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb76f4-9b26-46f9-b40b-e0051637a7d9 service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:39.897061 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:39.897917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:39.898202 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:39.898476 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] PATH_INFO: `/v3/users/26201b29a91540fa9410b15df6776122` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:39.899735 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26201b29a91540fa9410b15df6776122)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:39.903631 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:40.097492 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26201b29a91540fa9410b15df6776122'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.098082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26201b29a91540fa9410b15df6776122'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.104871 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26201b29a91540fa9410b15df6776122'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.116445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26201b29a91540fa9410b15df6776122'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.117080 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26201b29a91540fa9410b15df6776122'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.203543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1398/2802] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:39 2022] DELETE /identity/v3/users/26201b29a91540fa9410b15df6776122 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:40.207979 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:40.208451 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:40.208565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:40.225523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:40.226701 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:40.283360 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1405/2803] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:40.292807 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:40.294237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:40.350183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26c2d3-0843-4a23-bfd5-81597c945a2b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:40.353793 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:40.354435 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:40.354720 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:40.355000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:40.364193 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:40.365609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:40.375487 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1399/2804] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:40.788235 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:40.789706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:40.802993 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23291-9c08-4a75-8acb-b370d60a0443 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:40.807724 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:40.808670 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:40.809505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:40.809788 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] PATH_INFO: `/v3/projects/49bded6093e04224b8dbbe69d0e4406b` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:40.811205 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bded6093e04224b8dbbe69d0e4406b)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:40.813154 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:40.912419 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bded6093e04224b8dbbe69d0e4406b', 'request_id': 'req-6605d945-b805-49c2-8758-2044bb6ba96e'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.917942 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bded6093e04224b8dbbe69d0e4406b', 'request_id': 'req-6605d945-b805-49c2-8758-2044bb6ba96e'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:40.985510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bded6093e04224b8dbbe69d0e4406b', 'request_id': 'req-6605d945-b805-49c2-8758-2044bb6ba96e'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.000246 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] The token cache is being invalidate because project 49bded6093e04224b8dbbe69d0e4406b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:41.000538 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.001195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.002733 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1406/2805] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:40 2022] DELETE /identity/v3/projects/49bded6093e04224b8dbbe69d0e4406b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:41.007615 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:41.018384 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edff7b-e503-4b20-9c72-d49f95e32e2b service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:41.072137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:41.072992 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:41.073278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:41.073576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] PATH_INFO: `/v3/users/8e58b0e9cbda4421a9e616bff5259667` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:41.074742 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e58b0e9cbda4421a9e616bff5259667)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:41.077602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:41.232543 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e58b0e9cbda4421a9e616bff5259667'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.233418 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e58b0e9cbda4421a9e616bff5259667'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.240118 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e58b0e9cbda4421a9e616bff5259667'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.252805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e58b0e9cbda4421a9e616bff5259667'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.253449 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-978bb2ba-f263-47ff-95f1-280ef25116a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e58b0e9cbda4421a9e616bff5259667'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.340533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1400/2806] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:41 2022] DELETE /identity/v3/users/8e58b0e9cbda4421a9e616bff5259667 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:41.730729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:41.732959 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:41.747023 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605d945-b805-49c2-8758-2044bb6ba96e admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:41.803677 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:41.804552 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:41.804822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:41.805096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] PATH_INFO: `/v3/projects/c89e0a01414f437ab1e568838fa2f955` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:41.806255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89e0a01414f437ab1e568838fa2f955)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:41.808167 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:41.888908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89e0a01414f437ab1e568838fa2f955', 'request_id': 'req-c0916690-f1f9-418c-86b6-5e973bfebd30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.894526 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89e0a01414f437ab1e568838fa2f955', 'request_id': 'req-c0916690-f1f9-418c-86b6-5e973bfebd30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.963495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89e0a01414f437ab1e568838fa2f955', 'request_id': 'req-c0916690-f1f9-418c-86b6-5e973bfebd30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.975367 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] The token cache is being invalidate because project c89e0a01414f437ab1e568838fa2f955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:41.975653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.976318 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-c0916690-f1f9-418c-86b6-5e973bfebd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:41.977857 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1407/2807] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:41 2022] DELETE /identity/v3/projects/c89e0a01414f437ab1e568838fa2f955 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:41.983621 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:41.986888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:41.986888 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.002379 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:42.003583 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:42.061117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1401/2808] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:42.070026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.070334 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.070618 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.089270 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:42.090487 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:42.099609 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1408/2809] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:42.103656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.113096 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34bf9f-54e0-46ff-b836-418c99b64bc4 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.117602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.118232 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.118513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.118790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.119496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:42.119795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.121392 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.132330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1402/2810] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:42.136342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.146053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274a9c6-cec9-43aa-825d-d10a1733a470 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.150800 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.151471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.151753 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.152062 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.152752 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.155422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.227321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1409/2811] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:42 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:42.231311 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.241255 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf909-9fde-46bb-99bb-c30664073777 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.298437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.299099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.299381 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.299656 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.300393 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.302284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.364042 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1403/2812] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:42 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:42.368148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.378952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d9e6a-d632-438a-8006-617b756fe593 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.383524 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.384209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.384494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.384807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.385560 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.387139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.399311 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1410/2813] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:42.403335 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.413572 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b34da-a8f9-45f0-95c3-74e4cc46707f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.418223 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951bfa-7542-4877-aaa2-e9608c61684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.418875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951bfa-7542-4877-aaa2-e9608c61684b admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.419188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951bfa-7542-4877-aaa2-e9608c61684b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.419468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951bfa-7542-4877-aaa2-e9608c61684b admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.420466 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951bfa-7542-4877-aaa2-e9608c61684b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.422088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951bfa-7542-4877-aaa2-e9608c61684b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.431804 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1404/2814] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:42.436626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.446323 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4b226-b29b-4dcb-bd16-24f33dc6b57c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.451508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.452405 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.452685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.452957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] PATH_INFO: `/v3/projects/e3bb8c0eed7445c481c3738a8eceaf72/users/dfc1fe0e611f42bd9ab82b44fa510f13/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.467044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bb8c0eed7445c481c3738a8eceaf72, user_id=dfc1fe0e611f42bd9ab82b44fa510f13, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.469768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.575881 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1411/2815] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:42 2022] PUT /identity/v3/projects/e3bb8c0eed7445c481c3738a8eceaf72/users/dfc1fe0e611f42bd9ab82b44fa510f13/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:42.588213 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.588440 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.588722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.614666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] MFA Rules not processed for user `dfc1fe0e611f42bd9ab82b44fa510f13`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:42.615869 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:42.675748 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1405/2816] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:42.680280 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.738703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38d386-e982-40a3-984a-06cf13e5a581 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.743446 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.744123 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.744408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.744685 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.745378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.747239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:42.875136 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1412/2817] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:42 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:42.879181 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:42.889733 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a9dc-8525-4202-be7d-a19a7c41e3b1 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:42.949415 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:42.950069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:42.950345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:42.950619 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:42.951464 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:42.953585 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.095938 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1406/2818] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:42 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:43.100114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.111290 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc7553-3c0e-4051-bd3d-c5413af882b4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.115950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.116607 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.116895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.117176 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.117899 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.119489 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.130036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1413/2819] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:43.134194 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.144301 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd510-747c-48b2-9dbe-7f0421ef62d3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.148849 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.149709 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.149994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.150298 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] PATH_INFO: `/v3/projects/85e617c4c22547ac9a50fcb6626deffb/users/8473032a6f0140b19ad73af2a549521a/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.165137 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e617c4c22547ac9a50fcb6626deffb, user_id=8473032a6f0140b19ad73af2a549521a, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.167767 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.272317 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1407/2820] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:43 2022] PUT /identity/v3/projects/85e617c4c22547ac9a50fcb6626deffb/users/8473032a6f0140b19ad73af2a549521a/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:43.276508 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.286639 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ba72-c1f9-42a2-8d3c-4877a3031f33 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.340613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df45477-d35a-4a84-a65c-a5ad973cced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.341272 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45477-d35a-4a84-a65c-a5ad973cced4 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.342237 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45477-d35a-4a84-a65c-a5ad973cced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.342563 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45477-d35a-4a84-a65c-a5ad973cced4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.343347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df45477-d35a-4a84-a65c-a5ad973cced4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.344963 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df45477-d35a-4a84-a65c-a5ad973cced4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.354325 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1414/2821] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:43.359284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.369421 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cebb9-3dd8-4c27-8f5e-8d9538566064 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.374243 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.375101 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.375385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.375694 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] PATH_INFO: `/v3/projects/85e617c4c22547ac9a50fcb6626deffb/users/8473032a6f0140b19ad73af2a549521a/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.377697 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e617c4c22547ac9a50fcb6626deffb, user_id=8473032a6f0140b19ad73af2a549521a, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.380452 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.390919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1408/2822] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:43 2022] PUT /identity/v3/projects/85e617c4c22547ac9a50fcb6626deffb/users/8473032a6f0140b19ad73af2a549521a/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:43.401814 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.402114 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.402398 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.429977 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] MFA Rules not processed for user `8473032a6f0140b19ad73af2a549521a`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:43.431180 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:43.495808 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1415/2823] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:43.505620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:43.507285 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:43.562598 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c64f4d-3eaa-4c21-adc5-efd66967ab2b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:43.566220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507726fc-cfef-442f-940f-9396b1fc9f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:43.566877 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507726fc-cfef-442f-940f-9396b1fc9f9c service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:43.567163 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507726fc-cfef-442f-940f-9396b1fc9f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:43.567438 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507726fc-cfef-442f-940f-9396b1fc9f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:43.620795 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507726fc-cfef-442f-940f-9396b1fc9f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:43.622242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507726fc-cfef-442f-940f-9396b1fc9f9c service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:43.630774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1409/2824] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:46.621427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:46.680391 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090ced4-a816-47ac-b1a3-4fa7e6526a78 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:46.684887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:46.685735 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:46.686019 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:46.686295 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] PATH_INFO: `/v3/users/dfc1fe0e611f42bd9ab82b44fa510f13` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:46.688140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc1fe0e611f42bd9ab82b44fa510f13)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:46.690038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:46.891317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc1fe0e611f42bd9ab82b44fa510f13'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:46.897740 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc1fe0e611f42bd9ab82b44fa510f13'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:46.910476 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc1fe0e611f42bd9ab82b44fa510f13'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:46.911392 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc1fe0e611f42bd9ab82b44fa510f13'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:46.912122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc1fe0e611f42bd9ab82b44fa510f13'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:46.975923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1416/2825] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:46 2022] DELETE /identity/v3/users/dfc1fe0e611f42bd9ab82b44fa510f13 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:46.980539 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:46.981003 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:46.981088 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:46.998468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:46.999705 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:47.027267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:47.028684 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:47.063176 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1410/2826] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:47.072875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:47.074242 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:47.091494 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5afcf-e70d-48fb-9fd8-59880ec0dfe5 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:47.097139 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:47.098033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:47.098322 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:47.098601 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] PATH_INFO: `/v3/users/b25246a08cee439ea436f02d4039bb30` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:47.099807 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25246a08cee439ea436f02d4039bb30)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:47.101798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:47.131479 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9843d-fd85-443f-be91-8e7ed5e54265 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:47.135170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550fd26-e8db-454b-a676-ee63eff09df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:47.135808 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fd26-e8db-454b-a676-ee63eff09df3 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:47.136129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fd26-e8db-454b-a676-ee63eff09df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:47.136408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550fd26-e8db-454b-a676-ee63eff09df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:47.146142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fd26-e8db-454b-a676-ee63eff09df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:47.147512 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550fd26-e8db-454b-a676-ee63eff09df3 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:47.157786 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1411/2827] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:47.285210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25246a08cee439ea436f02d4039bb30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.292087 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25246a08cee439ea436f02d4039bb30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.303484 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25246a08cee439ea436f02d4039bb30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.304212 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25246a08cee439ea436f02d4039bb30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.304819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25246a08cee439ea436f02d4039bb30'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.408764 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1417/2828] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:47 2022] DELETE /identity/v3/users/b25246a08cee439ea436f02d4039bb30 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:47.412275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:47.412728 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:47.413216 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:47.430339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:47.431531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:47.489698 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1412/2829] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:47.499449 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:47.500927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:47.555666 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92518781-e92f-43f1-9abf-320b7c6260c4 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:47.559293 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:47.559958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:47.560242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:47.560545 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:47.570373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:47.571798 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:47.581887 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1418/2830] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:47.588523 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:47.590012 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:47.602095 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe9e6a-aa29-4c3e-8aad-d732b2228190 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:47.606774 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:47.607622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:47.607942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:47.608218 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] PATH_INFO: `/v3/projects/e3bb8c0eed7445c481c3738a8eceaf72` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:47.610330 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bb8c0eed7445c481c3738a8eceaf72)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:47.611901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:47.723710 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bb8c0eed7445c481c3738a8eceaf72', 'request_id': 'req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.729863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bb8c0eed7445c481c3738a8eceaf72', 'request_id': 'req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.735390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bb8c0eed7445c481c3738a8eceaf72', 'request_id': 'req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.826589 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] The token cache is being invalidate because project e3bb8c0eed7445c481c3738a8eceaf72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:47.827116 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.828653 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:47.830295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1413/2831] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:47 2022] DELETE /identity/v3/projects/e3bb8c0eed7445c481c3738a8eceaf72 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:47.834168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:47.844122 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a92fa-27eb-4cc9-b63c-84adf433783e service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:47.902512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:47.903418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:47.903700 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:47.904047 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] PATH_INFO: `/v3/users/8473032a6f0140b19ad73af2a549521a` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:47.905238 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8473032a6f0140b19ad73af2a549521a)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:47.907339 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:48.028336 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:48.029811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:48.042809 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c482c5-b8d3-4bf5-95ed-3d0c0b3f32cd admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:48.048368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:48.049224 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:48.049513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:48.049794 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] PATH_INFO: `/v3/projects/abb863b1a8b843dc9a32fc54bfce8eb6` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:48.050985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb863b1a8b843dc9a32fc54bfce8eb6)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:48.052985 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:48.153583 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8473032a6f0140b19ad73af2a549521a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.160514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8473032a6f0140b19ad73af2a549521a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.172784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8473032a6f0140b19ad73af2a549521a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.173467 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8473032a6f0140b19ad73af2a549521a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.174128 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8473032a6f0140b19ad73af2a549521a'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.175942 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb863b1a8b843dc9a32fc54bfce8eb6', 'request_id': 'req-759e85ff-f864-4eee-adbf-502f638ffc8f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.182094 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb863b1a8b843dc9a32fc54bfce8eb6', 'request_id': 'req-759e85ff-f864-4eee-adbf-502f638ffc8f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.188195 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb863b1a8b843dc9a32fc54bfce8eb6', 'request_id': 'req-759e85ff-f864-4eee-adbf-502f638ffc8f'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.220456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1419/2832] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:47 2022] DELETE /identity/v3/users/8473032a6f0140b19ad73af2a549521a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:48.272114 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] The token cache is being invalidate because project abb863b1a8b843dc9a32fc54bfce8eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:48.272344 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.272979 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.274522 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1414/2833] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:48 2022] DELETE /identity/v3/projects/abb863b1a8b843dc9a32fc54bfce8eb6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:48.278507 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:48.279994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:48.347190 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4e97-8a1f-4f94-a5ec-d070d8b476b8 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:48.351957 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:48.352910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:48.353198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:48.353478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] PATH_INFO: `/v3/users/369dac72b1e44e149d334d4d6d1f92c5` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:48.354706 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=369dac72b1e44e149d334d4d6d1f92c5)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:48.356713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:48.833043 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '369dac72b1e44e149d334d4d6d1f92c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.839514 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '369dac72b1e44e149d334d4d6d1f92c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.851651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '369dac72b1e44e149d334d4d6d1f92c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.852376 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '369dac72b1e44e149d334d4d6d1f92c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.852990 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-865cd9b4-b5f1-49ec-b50e-17ab3934bff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '369dac72b1e44e149d334d4d6d1f92c5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:48.855641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:48.857272 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:48.923943 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e85ff-f864-4eee-adbf-502f638ffc8f admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:48.929010 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:48.929853 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:48.930132 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:48.930407 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] PATH_INFO: `/v3/projects/85e617c4c22547ac9a50fcb6626deffb` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:48.931576 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e617c4c22547ac9a50fcb6626deffb)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:48.933503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:48.953465 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1420/2834] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:47:48 2022] DELETE /identity/v3/users/369dac72b1e44e149d334d4d6d1f92c5 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:49.060528 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e617c4c22547ac9a50fcb6626deffb', 'request_id': 'req-996284fd-e359-4ac5-a3af-c24d0e34a2bd'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.067542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e617c4c22547ac9a50fcb6626deffb', 'request_id': 'req-996284fd-e359-4ac5-a3af-c24d0e34a2bd'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.072881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e617c4c22547ac9a50fcb6626deffb', 'request_id': 'req-996284fd-e359-4ac5-a3af-c24d0e34a2bd'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.157778 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] The token cache is being invalidate because project 85e617c4c22547ac9a50fcb6626deffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:49.158059 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.158734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-996284fd-e359-4ac5-a3af-c24d0e34a2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.160692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1415/2835] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:48 2022] DELETE /identity/v3/projects/85e617c4c22547ac9a50fcb6626deffb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:49.165312 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.165584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.165875 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.183481 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:49.184710 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.246593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1421/2836] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:49.255039 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.255338 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.255623 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.275180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:49.276442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.284964 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1416/2837] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:49.289025 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.305509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a82ad7-398e-4867-866e-fe3fc2007fe4 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.305509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.305509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.305509 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.305891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.305891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:49.305891 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.306698 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.318779 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1422/2838] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:47:49.323130 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.333000 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ba17-ab31-4305-b8c0-7cf35f86c616 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.337764 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.338401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.338687 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.338965 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.339716 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.341891 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.383090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.387969 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.399458 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1560d22-6e5e-40df-ad83-f7eb101adbb6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.404523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.405421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.405916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.406514 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1417/2839] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:49.406634 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] PATH_INFO: `/v3/projects/2adc415f95e0421abdd6478e78309d4e` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.407566 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adc415f95e0421abdd6478e78309d4e)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.409525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.413032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.473865 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb273c-6764-43d6-a7df-7ddf64b109f0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.478604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.479284 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.479602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.479909 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.480602 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.482496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.512949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adc415f95e0421abdd6478e78309d4e', 'request_id': 'req-d50a2d70-115a-49df-bd75-6442d23705b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.518985 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adc415f95e0421abdd6478e78309d4e', 'request_id': 'req-d50a2d70-115a-49df-bd75-6442d23705b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.564055 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1418/2840] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:49.568222 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.577840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e393e2d-83b3-45e2-b4b3-2c139470b61b admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.590910 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adc415f95e0421abdd6478e78309d4e', 'request_id': 'req-d50a2d70-115a-49df-bd75-6442d23705b4'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.603148 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] The token cache is being invalidate because project 2adc415f95e0421abdd6478e78309d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:47:49.611092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.611092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-d50a2d70-115a-49df-bd75-6442d23705b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:47:49.611092 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1423/2841] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:47:49 2022] DELETE /identity/v3/projects/2adc415f95e0421abdd6478e78309d4e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:49.615433 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe5ce-699a-4629-a1f4-9a07ba9e85e0 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.615727 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe5ce-699a-4629-a1f4-9a07ba9e85e0 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.616027 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe5ce-699a-4629-a1f4-9a07ba9e85e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.634005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-2bfbe5ce-699a-4629-a1f4-9a07ba9e85e0 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:49.635044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-2bfbe5ce-699a-4629-a1f4-9a07ba9e85e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.635956 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.636629 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.636910 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.637189 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.637913 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.639495 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.643009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1424/2842] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:49.649563 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1419/2843] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:49.651870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.652199 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.652483 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.653093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.654775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.667115 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2039d3-def8-4bbe-95a6-d2b4d69d014e admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.670277 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:49.672015 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.672304 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.672949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.673230 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.673503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.674231 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.675862 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.679757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1425/2844] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:49.683824 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.689111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1420/2845] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:49.690082 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.693412 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11048f75-c564-4701-8667-446cfa9fb10b None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.697994 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.698627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.698907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.699181 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.699468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf564a-0b9f-4b88-a82e-bbc64a9f20b1 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.699919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:47:49.700228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.701787 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.704205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222948a-f24e-41e1-8c13-480e66d36561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.705051 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222948a-f24e-41e1-8c13-480e66d36561 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.705465 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222948a-f24e-41e1-8c13-480e66d36561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.705773 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222948a-f24e-41e1-8c13-480e66d36561 admin admin] PATH_INFO: `/v3/projects/bcf09a28d1c5451f9a3f11d7e2ad7b5f/users/4fb38c17dbbb422ba09f0e002219bf55/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.713168 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1426/2846] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 01:47:49.717672 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.720649 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222948a-f24e-41e1-8c13-480e66d36561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf09a28d1c5451f9a3f11d7e2ad7b5f, user_id=4fb38c17dbbb422ba09f0e002219bf55, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.723390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222948a-f24e-41e1-8c13-480e66d36561 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.727042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe15265-4ae4-4454-abad-a4758f3cd76c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.731422 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.732127 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.737080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.737080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.737080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.737080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.843236 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1421/2847] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:49 2022] PUT /identity/v3/projects/bcf09a28d1c5451f9a3f11d7e2ad7b5f/users/4fb38c17dbbb422ba09f0e002219bf55/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:49.848553 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.848845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.849127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.866813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:49.870827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1427/2848] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:49.871295 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.871715 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.926136 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1422/2849] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:49.932561 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e688a-d044-46d8-9310-291fc4cd1b3c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.935704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:49.937060 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:49.937403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.938069 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.938356 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.938757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:49.939482 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:49.941406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:49.992790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4f60b-1031-4e83-a133-a7448c573c29 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:49.996489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:49.997126 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:49.997411 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:49.997690 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.007191 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.008660 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.014581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1428/2850] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:49 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:50.018732 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1423/2851] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:47:50.019332 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.029080 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b66fe-584c-4b2c-8926-1fb5b3cd8cf6 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.033973 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.034645 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.034932 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.035209 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.036024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.037657 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.047525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1429/2852] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:50.051673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.061308 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd669fb-ca1a-4195-a5c1-e3090992839b service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.066627 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173f0d5-8477-41d4-9c30-3f8bf6e5e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.067264 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f0d5-8477-41d4-9c30-3f8bf6e5e4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.067544 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f0d5-8477-41d4-9c30-3f8bf6e5e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.067817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173f0d5-8477-41d4-9c30-3f8bf6e5e4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.068591 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173f0d5-8477-41d4-9c30-3f8bf6e5e4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.070155 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173f0d5-8477-41d4-9c30-3f8bf6e5e4aa admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.081182 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1424/2853] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:50.085294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.095820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7432-9a57-4ae6-99c4-0ce147ad6a89 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.100782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.102691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.102691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.102691 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] PATH_INFO: `/v3/projects/dea07cf753f346c6a9e1d3b2f1654bc8/users/ce986fc00d9d41ceab37605055aea437/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.117746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea07cf753f346c6a9e1d3b2f1654bc8, user_id=ce986fc00d9d41ceab37605055aea437, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.120486 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.169510 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1430/2854] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:50 2022] PUT /identity/v3/projects/dea07cf753f346c6a9e1d3b2f1654bc8/users/ce986fc00d9d41ceab37605055aea437/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:50.225058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.226071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.226071 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.253152 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] MFA Rules not processed for user `ce986fc00d9d41ceab37605055aea437`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:50.257024 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:50.328339 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1425/2855] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:50.332918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.395920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415116c-761a-4607-ac25-97809a437295 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.400703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.401353 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.401641 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.401922 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.402626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.404587 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.490904 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1431/2856] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:47:50 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:47:50.491247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.502403 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6816d-690f-4ccf-a90a-26c6cc96dd52 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.563422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.564147 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.564412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.564714 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.565467 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.567382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.673736 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1426/2857] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:47:50 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:47:50.677653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.688113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdde84-4251-4a7e-b95f-29435c3b2550 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.693010 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.693746 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.694102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.694519 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.695264 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.696919 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.708565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1432/2858] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:47:50.712754 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.724461 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f118-8d3c-4c22-99c1-05627cba4bb7 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.729494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.731450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.731450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.731450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] PATH_INFO: `/v3/projects/0ffe418b1feb47e49efcd193255aab32/users/d1ce74388f8e40f0b7aaacf024790614/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.746592 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffe418b1feb47e49efcd193255aab32, user_id=d1ce74388f8e40f0b7aaacf024790614, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.749346 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.844806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1427/2859] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:50 2022] PUT /identity/v3/projects/0ffe418b1feb47e49efcd193255aab32/users/d1ce74388f8e40f0b7aaacf024790614/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:47:50.849059 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.859723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6de927-c2ad-4567-9273-b306cc0bf5e3 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.913751 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c457c-5e2d-48ff-a314-f786fa811980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.914407 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c457c-5e2d-48ff-a314-f786fa811980 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.914686 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c457c-5e2d-48ff-a314-f786fa811980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.914987 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c457c-5e2d-48ff-a314-f786fa811980 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.915713 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c457c-5e2d-48ff-a314-f786fa811980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.917355 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c457c-5e2d-48ff-a314-f786fa811980 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.928152 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1433/2860] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 01:47:50.932360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:50.942775 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899f7cb-077a-46fe-9291-61c6734bdd03 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:50.947527 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:50.948633 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.948765 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.948975 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] PATH_INFO: `/v3/projects/0ffe418b1feb47e49efcd193255aab32/users/d1ce74388f8e40f0b7aaacf024790614/roles/30d31529b5824c178844aea14bad4358` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:50.951133 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ffe418b1feb47e49efcd193255aab32, user_id=d1ce74388f8e40f0b7aaacf024790614, role_id=30d31529b5824c178844aea14bad4358)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:50.954453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:50.965531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1428/2861] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:47:50 2022] PUT /identity/v3/projects/0ffe418b1feb47e49efcd193255aab32/users/d1ce74388f8e40f0b7aaacf024790614/roles/30d31529b5824c178844aea14bad4358 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:47:50.977053 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05e5d-a308-44fd-869b-60a62881348b None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:50.984198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05e5d-a308-44fd-869b-60a62881348b None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:50.984198 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05e5d-a308-44fd-869b-60a62881348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:51.007044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-98d05e5d-a308-44fd-869b-60a62881348b None None] MFA Rules not processed for user `d1ce74388f8e40f0b7aaacf024790614`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:51.007044 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-98d05e5d-a308-44fd-869b-60a62881348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:51.071042 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1434/2862] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:47:51.081680 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:51.083447 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:51.138453 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e566aa-d645-4a51-9a0c-0a1eb3b4cbf5 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:51.145035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:51.145035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:51.145035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:51.145035 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:51.200890 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:51.203331 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:51.212724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1429/2863] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:51.236160 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee29b0-6ea7-4c73-b346-197d480e4ac8 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:51.236518 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee29b0-6ea7-4c73-b346-197d480e4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:51.236729 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee29b0-6ea7-4c73-b346-197d480e4ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:51.266983 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c4ee29b0-6ea7-4c73-b346-197d480e4ac8 None None] MFA Rules not processed for user `4fb38c17dbbb422ba09f0e002219bf55`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:51.268288 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c4ee29b0-6ea7-4c73-b346-197d480e4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:51.344423 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1435/2864] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:51.350789 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:51.352450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:51.363949 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581a544-d01d-48c2-8fcc-b08c773ca9af service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:51.367638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:51.368306 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:51.368588 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:51.368867 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:51.378327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:51.379740 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:51.388565 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1430/2865] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:53.131916 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:53.132410 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:53.132517 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:53.150654 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] MFA Rules not processed for user `4fb38c17dbbb422ba09f0e002219bf55`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:47:53.151931 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:53.158815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1436/2866] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:47:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:47:53.569165 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:53.570596 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:53.639428 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc3f01-c135-4687-8fc5-9199b309937f service cinder] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:53.645531 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:53.646178 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:53.646494 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:53.647827 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:53.648679 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:47:53.661119 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:53.662692 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bde46-f35b-4876-9d80-2490e975f654 service placement] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:53.672575 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1431/2867] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:47:57.417004 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:47:57.427317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895512a0-6b5d-4420-9506-7fb1243f15db None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:47:57.431076 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:47:57.431708 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:47:57.432026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:47:57.432303 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:47:57.442072 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:47:57.443539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:47:57.454151 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1437/2868] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:19.616225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:19.616731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:19.616731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:19.634057 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] MFA Rules not processed for user `4fb38c17dbbb422ba09f0e002219bf55`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:19.635237 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:19.642296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1432/2869] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:19.866920 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:19.918827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885fa2-c230-4d91-8882-dc059493242b service cinder] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:19.922453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:19.923651 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:19.924011 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:19.924346 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:19.926103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:19.935557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:19.937064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:19.945251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1438/2870] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:20.331372 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:20.343706 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac28bf-c3cd-480b-87be-e74a26339b23 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:20.350145 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:20.350611 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:20.350897 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:20.351220 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:20.357275 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:20.370062 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:20.371676 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:20.382180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1433/2871] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:23.162406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:23.163950 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:23.174795 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc660874-1d39-4424-b7a8-dc317c290d30 service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:23.178830 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:23.179454 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:23.179755 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:23.180101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:23.181939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:23.192593 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:23.196952 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef99721-5693-402c-98ea-b95f509766ca service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:23.202208 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1439/2872] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:24.165425 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:24.226685 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09623ba-b7ab-43bd-a8bd-00490026b47e service placement] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:24.231382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:24.232279 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:24.232564 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:24.232840 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] PATH_INFO: `/v3/users/ce986fc00d9d41ceab37605055aea437` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:24.234022 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce986fc00d9d41ceab37605055aea437)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:24.235962 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:24.370473 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce986fc00d9d41ceab37605055aea437'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:24.371129 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce986fc00d9d41ceab37605055aea437'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:24.378646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce986fc00d9d41ceab37605055aea437'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:24.390089 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce986fc00d9d41ceab37605055aea437'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:24.390782 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce986fc00d9d41ceab37605055aea437'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:24.454503 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1434/2873] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:48:24 2022] DELETE /identity/v3/users/ce986fc00d9d41ceab37605055aea437 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:24.460058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:24.460525 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:24.460623 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:24.478210 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:24.479345 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:24.539544 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1440/2874] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:24.549174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:24.550845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:24.607701 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc2cfc-ed24-44d1-90b8-b1961762ec82 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:24.611380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:24.612604 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:24.612894 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:24.613168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:24.622159 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:24.623578 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:24.633542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1435/2875] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:25.045562 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:25.047102 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:25.059908 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3cdf62-8f77-4a14-830c-7598cb6c24e2 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:25.064528 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:25.065760 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:25.066131 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:25.066418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] PATH_INFO: `/v3/projects/dea07cf753f346c6a9e1d3b2f1654bc8` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:25.067621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea07cf753f346c6a9e1d3b2f1654bc8)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:25.069661 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:25.161408 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea07cf753f346c6a9e1d3b2f1654bc8', 'request_id': 'req-8055c75c-9790-412b-9cd3-d9c3065fb2c9'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.166608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea07cf753f346c6a9e1d3b2f1654bc8', 'request_id': 'req-8055c75c-9790-412b-9cd3-d9c3065fb2c9'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.224816 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea07cf753f346c6a9e1d3b2f1654bc8', 'request_id': 'req-8055c75c-9790-412b-9cd3-d9c3065fb2c9'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.235673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] The token cache is being invalidate because project dea07cf753f346c6a9e1d3b2f1654bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:48:25.235996 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.237286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.238907 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1441/2876] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:48:25 2022] DELETE /identity/v3/projects/dea07cf753f346c6a9e1d3b2f1654bc8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:25.242884 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:25.252278 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a803a-db34-4476-9f3b-881ecc6ad29d service neutron] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:25.306382 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:25.307161 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:25.307445 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:25.307722 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] PATH_INFO: `/v3/users/d1ce74388f8e40f0b7aaacf024790614` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:25.308935 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ce74388f8e40f0b7aaacf024790614)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:25.310832 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:25.490824 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ce74388f8e40f0b7aaacf024790614'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.491470 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ce74388f8e40f0b7aaacf024790614'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.498408 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ce74388f8e40f0b7aaacf024790614'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.509919 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ce74388f8e40f0b7aaacf024790614'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.510571 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5e3a725c-5aa5-4572-a1e6-7d2b00231694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ce74388f8e40f0b7aaacf024790614'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:25.619391 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1436/2877] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:48:25 2022] DELETE /identity/v3/users/d1ce74388f8e40f0b7aaacf024790614 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:26.037555 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.039005 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:26.052822 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c75c-9790-412b-9cd3-d9c3065fb2c9 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.110796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.111658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.112036 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.112316 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] PATH_INFO: `/v3/projects/0ffe418b1feb47e49efcd193255aab32` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.113522 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ffe418b1feb47e49efcd193255aab32)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.115394 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.231636 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ffe418b1feb47e49efcd193255aab32', 'request_id': 'req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:26.237382 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ffe418b1feb47e49efcd193255aab32', 'request_id': 'req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:26.328243 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ffe418b1feb47e49efcd193255aab32', 'request_id': 'req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:26.340317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] The token cache is being invalidate because project 0ffe418b1feb47e49efcd193255aab32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:48:26.340610 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:26.341361 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-9d3b20e1-3b24-4c82-9030-a882e4ed73d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:26.343150 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1442/2878] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:48:26 2022] DELETE /identity/v3/projects/0ffe418b1feb47e49efcd193255aab32 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:26.349745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.350225 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.353620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.368560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:26.369761 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:26.426432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1437/2879] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:26.434557 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.434852 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.435140 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.454409 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:26.455594 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:26.464434 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1443/2880] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:48:26.468994 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.478957 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7895d-f609-4f3b-8309-862fcd070025 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.483499 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.484171 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.484456 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.484734 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.485450 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:48:26.485755 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.487340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.498490 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1438/2881] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:48:26.502546 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.513773 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393cc97-aad8-4213-86b4-c13c8f095467 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.518421 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.519734 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.520268 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.520663 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.521363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.523241 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.609782 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1444/2882] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:48:26 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:48:26.613954 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.624043 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c229b-1452-460b-8a36-7c53215b6efb admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.678863 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.679437 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.679724 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.680032 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.680752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.682638 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.762966 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1439/2883] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:48:26 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:48:26.766923 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.778125 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e371b-c07a-4136-bbe2-8b4f843f0b50 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.782813 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.783681 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.783997 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.784278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.785321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.786948 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.797364 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1445/2884] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:48:26.801646 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.811659 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3e192-7394-4ac2-9db8-f89bff611275 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.817542 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d679fb-7979-4283-9435-24fd5eeb14c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.818241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d679fb-7979-4283-9435-24fd5eeb14c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.818524 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d679fb-7979-4283-9435-24fd5eeb14c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.818798 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d679fb-7979-4283-9435-24fd5eeb14c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.819517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d679fb-7979-4283-9435-24fd5eeb14c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.821174 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d679fb-7979-4283-9435-24fd5eeb14c2 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.830845 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1440/2885] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:48:26.835363 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:26.845321 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a50656-13d8-48f3-9f03-7ab936670683 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:26.850426 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:26.851385 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] REQUEST_METHOD: `PUT` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.851703 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.852064 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] PATH_INFO: `/v3/projects/d5d7fa86e07746f487225512035fb083/users/d4ee747280e44d268e12bc41fed585c8/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.867780 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d7fa86e07746f487225512035fb083, user_id=d4ee747280e44d268e12bc41fed585c8, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:26.870439 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:26.951554 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1446/2886] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:48:26 2022] PUT /identity/v3/projects/d5d7fa86e07746f487225512035fb083/users/d4ee747280e44d268e12bc41fed585c8/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:48:26.962105 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:26.962380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:26.962665 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:26.989813 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] MFA Rules not processed for user `d4ee747280e44d268e12bc41fed585c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:26.990999 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:27.052127 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1441/2887] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:27.079379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:27.081138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:27.137255 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472af3a1-e2a3-4bc4-b9bb-d40000ef5524 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:27.141090 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c652f-69e0-4b93-9b28-3b019ee9ce8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:27.141739 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c652f-69e0-4b93-9b28-3b019ee9ce8d service cinder] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:27.142030 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c652f-69e0-4b93-9b28-3b019ee9ce8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:27.142309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c652f-69e0-4b93-9b28-3b019ee9ce8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:27.150643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c652f-69e0-4b93-9b28-3b019ee9ce8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:27.152095 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c652f-69e0-4b93-9b28-3b019ee9ce8d service cinder] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:27.162066 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1447/2888] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:27.177776 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:27.243268 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f15f8-489b-4f7f-a6ae-eb5a1641dd20 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:27.247858 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:27.248717 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:27.248997 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:27.249274 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] PATH_INFO: `/v3/users/d4ee747280e44d268e12bc41fed585c8` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:27.250498 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ee747280e44d268e12bc41fed585c8)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:27.252436 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:27.464468 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ee747280e44d268e12bc41fed585c8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:27.465142 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ee747280e44d268e12bc41fed585c8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:27.472673 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ee747280e44d268e12bc41fed585c8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:27.484241 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ee747280e44d268e12bc41fed585c8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:27.484933 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ee747280e44d268e12bc41fed585c8'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:27.564385 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1442/2889] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:48:27 2022] DELETE /identity/v3/users/d4ee747280e44d268e12bc41fed585c8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:27.569186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:27.569478 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:27.569757 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:27.586810 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:27.588026 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:27.642820 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1448/2890] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:27.653046 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:27.654422 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:27.708554 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcece2c-e7f0-4b22-9c95-e959b71cc391 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:27.712170 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892b53-af7e-4606-89ec-b421d35b11d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:27.712791 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892b53-af7e-4606-89ec-b421d35b11d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:27.713070 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892b53-af7e-4606-89ec-b421d35b11d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:27.713342 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892b53-af7e-4606-89ec-b421d35b11d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:27.723005 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892b53-af7e-4606-89ec-b421d35b11d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:27.724496 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892b53-af7e-4606-89ec-b421d35b11d6 service neutron] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:27.733569 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1443/2891] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:48:28.142863 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.145278 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:28.158085 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab445-c2e3-4cda-99c7-749c3526818e None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.162796 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.164251 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.164541 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.164819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] PATH_INFO: `/v3/projects/d5d7fa86e07746f487225512035fb083` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.166187 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d7fa86e07746f487225512035fb083)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.168186 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.272378 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d7fa86e07746f487225512035fb083', 'request_id': 'req-b1d500fc-17e9-4519-8f8d-a34f8171606f'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:28.277575 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d7fa86e07746f487225512035fb083', 'request_id': 'req-b1d500fc-17e9-4519-8f8d-a34f8171606f'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:28.347173 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d7fa86e07746f487225512035fb083', 'request_id': 'req-b1d500fc-17e9-4519-8f8d-a34f8171606f'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:28.359553 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] The token cache is being invalidate because project d5d7fa86e07746f487225512035fb083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79591) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:48:28.360103 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:28.360894 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-b1d500fc-17e9-4519-8f8d-a34f8171606f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:48:28.362531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1449/2892] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:48:28 2022] DELETE /identity/v3/projects/d5d7fa86e07746f487225512035fb083 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:28.367792 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.368183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.370327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.388160 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:28.389303 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:28.451917 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1444/2893] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:28.461373 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.461768 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.462145 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.481660 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:28.483149 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:28.491589 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1450/2894] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:28.496144 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.505875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00dd0-3bcc-4f84-ab03-289314c53ef2 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.510412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.511083 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.511364 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.511641 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] PATH_INFO: `/v3/domains` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.512419 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79590) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:48:28.512731 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.514315 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.525874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1445/2895] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:48:28.530024 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.539539 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d0b10-ef6a-4c6f-9856-17022b5e711f None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.544195 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.544832 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.545113 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.545387 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] PATH_INFO: `/v3/projects` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.546093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.547993 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.634464 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1451/2896] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:48:28 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:48:28.638622 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.649205 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30883f-4e2c-4cac-882f-6e1e78309caf admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.704426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.705085 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.705412 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.705704 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] PATH_INFO: `/v3/users` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.706387 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.709250 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.776817 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1446/2897] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:48:28 2022] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:48:28.780945 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.791473 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4211-0f8b-49a9-bc37-74608fffa392 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.796403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.799640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.799640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.799640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.799640 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.800174 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.810705 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1452/2898] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:48:28.814655 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.825281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b88d19-80b4-4f06-babb-71c68a156744 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.830686 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.834037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.834037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.834037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.834037 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.835549 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.838401 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.840286 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:28.851901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1447/2899] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:48:28.852955 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:28.862934 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090beb7f-a2df-4710-9f0f-38da040cf053 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.867932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.868810 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.869093 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.869409 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] PATH_INFO: `/v3/projects/96775a20b26340d9b854af29743fbffa/users/48fb8f0682594fe8acc450736c5ea23c/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.885870 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96775a20b26340d9b854af29743fbffa, user_id=48fb8f0682594fe8acc450736c5ea23c, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.896674 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.917342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7497acf-ce6c-4595-a99b-8f9f441f72dc admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:28.922918 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d58bb9324d548b9b0e5fec7ae458a6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:28.925744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:28.925744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:28.925744 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:28.926097 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:28.938527 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:28.940121 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95fbdf-7cd4-4e59-9b45-ae63ae4413f6 service nova] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:28.951138 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1453/2900] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:48:28.997475 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1448/2901] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:48:28 2022] PUT /identity/v3/projects/96775a20b26340d9b854af29743fbffa/users/48fb8f0682594fe8acc450736c5ea23c/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:48:29.008521 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0784f0e-7a25-4057-829e-c9f8f53f70a1 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:29.008902 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0784f0e-7a25-4057-829e-c9f8f53f70a1 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:29.009267 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0784f0e-7a25-4057-829e-c9f8f53f70a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:29.036643 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-c0784f0e-7a25-4057-829e-c9f8f53f70a1 None None] MFA Rules not processed for user `48fb8f0682594fe8acc450736c5ea23c`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:29.037865 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-c0784f0e-7a25-4057-829e-c9f8f53f70a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:29.100455 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1454/2902] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:48:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:29.111750 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:29.114426 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:29.178183 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd20c57-1328-483c-96ee-e254d01d70c3 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:29.181796 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14e036fb8f904380a1f0d15e085f3948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:29.182432 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:29.182721 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:29.183001 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:29.192168 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:29.193595 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:29.202560 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1449/2903] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:48:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 01:48:43.875982 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c841-3072-493e-a565-ef21122ed5cf None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:43.876456 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c841-3072-493e-a565-ef21122ed5cf None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:43.876559 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19c841-3072-493e-a565-ef21122ed5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:43.894819 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-8f19c841-3072-493e-a565-ef21122ed5cf None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:48:43.896058 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-8f19c841-3072-493e-a565-ef21122ed5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:43.952658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1455/2904] 10.222.0.91 () {58 vars in 1009 bytes} [Mon Feb 21 01:48:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:48:44.092550 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:48:44.094058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:48:44.160918 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316cbc1-0589-44f8-ba1c-74061166d73f service glance] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:48:44.166281 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:48:44.167167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:48:44.167457 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:48:44.167763 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:48:44.175533 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:48:44.177124 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:48:44.184874 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1450/2905] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:48:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:49:03.344696 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:03.345216 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:03.345314 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:03.366778 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] MFA Rules not processed for user `70eaa9515db94bc99055f1f8db7890ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:49:03.368033 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:03.375347 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1456/2906] 10.222.0.91 () {58 vars in 967 bytes} [Mon Feb 21 01:49:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:49:03.388212 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:03.401961 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db43e6-e7cd-41f9-ba7e-526d8cac0fb2 service swift] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:03.407079 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bde8ac2fb5804342b943a6999b23fedd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:03.407743 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:03.408058 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:03.408357 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:03.417759 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:03.419343 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:03.427513 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1451/2907] 10.222.0.91 () {60 vars in 1384 bytes} [Mon Feb 21 01:49:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 01:49:06.487254 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:06.488827 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:06.557294 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a36b0e-1ad2-41e1-a3c0-0d2117fb7718 None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:06.561864 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:06.562723 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:06.563009 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:06.563291 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] PATH_INFO: `/v3/users/4fb38c17dbbb422ba09f0e002219bf55` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:06.564531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb38c17dbbb422ba09f0e002219bf55)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:06.566471 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:06.798731 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb38c17dbbb422ba09f0e002219bf55'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:06.806565 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb38c17dbbb422ba09f0e002219bf55'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:06.818178 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb38c17dbbb422ba09f0e002219bf55'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:06.818890 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb38c17dbbb422ba09f0e002219bf55'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:06.819495 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-3ce2cde8-15b5-4120-81c5-6cb956716327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb38c17dbbb422ba09f0e002219bf55'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:06.917403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1457/2908] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:49:06 2022] DELETE /identity/v3/users/4fb38c17dbbb422ba09f0e002219bf55 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:49:07.181682 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:07.193360 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de011d4-c70c-40d8-bcc0-89b0435566f9 service swift] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:07.251309 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:07.252186 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.252474 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.252751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] PATH_INFO: `/v3/projects/bcf09a28d1c5451f9a3f11d7e2ad7b5f` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.253926 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf09a28d1c5451f9a3f11d7e2ad7b5f)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:07.255852 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:07.385486 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'request_id': 'req-36131cc4-5b4c-4a75-89a4-573f24513c06'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:07.392167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'request_id': 'req-36131cc4-5b4c-4a75-89a4-573f24513c06'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:07.397753 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf09a28d1c5451f9a3f11d7e2ad7b5f', 'request_id': 'req-36131cc4-5b4c-4a75-89a4-573f24513c06'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:07.476214 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] The token cache is being invalidate because project bcf09a28d1c5451f9a3f11d7e2ad7b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:49:07.477072 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:07.477745 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-36131cc4-5b4c-4a75-89a4-573f24513c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:07.479294 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1452/2909] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:49:07 2022] DELETE /identity/v3/projects/bcf09a28d1c5451f9a3f11d7e2ad7b5f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:49:07.484377 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.484673 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.484958 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.503621 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:49:07.504960 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:07.563679 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1458/2910] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 01:49:07.571881 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.572180 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.572463 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.593401 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:49:07.594609 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:07.604312 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1453/2911] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:49:07.608829 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:07.619403 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6b58d-b0b0-4953-a8f3-8af77238273f None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:07.624219 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:07.624872 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.625155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.625427 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] PATH_INFO: `/v3/domains` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.626155 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79591) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 01:49:07.626470 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:07.628061 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:07.639592 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1459/2912] 10.222.0.91 () {58 vars in 1152 bytes} [Mon Feb 21 01:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 01:49:07.644028 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:07.653535 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a40f6-17d6-44dc-80a4-572fc26ad4f3 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:07.658146 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:07.658772 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.659054 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.659327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.660063 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:07.661931 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:07.760167 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1454/2913] 10.222.0.91 () {60 vars in 1152 bytes} [Mon Feb 21 01:49:07 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 01:49:07.765306 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:07.775792 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef684b-5f92-4da2-89d9-39e6a845252c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:07.830626 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:07.831282 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.831627 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.831939 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] PATH_INFO: `/v3/users` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.832628 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:07.834499 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:07.924927 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1460/2914] 10.222.0.91 () {60 vars in 1143 bytes} [Mon Feb 21 01:49:07 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 01:49:07.929153 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:07.939270 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a2537-b1f0-458a-9cc8-d9c96c9313f0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:07.943970 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:07.944620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.944903 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.946233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.946233 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:07.948123 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:07.958491 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1455/2915] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:49:07.962330 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:07.973726 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f85dc1-e228-4db7-af8a-5c2d400c936c admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:07.978665 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b5c6f-1a58-4e6e-be7b-7df64d0fb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:07.979326 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5c6f-1a58-4e6e-be7b-7df64d0fb676 admin admin] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:07.979614 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5c6f-1a58-4e6e-be7b-7df64d0fb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:07.979929 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b5c6f-1a58-4e6e-be7b-7df64d0fb676 admin admin] PATH_INFO: `/v3/roles` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:07.980693 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b5c6f-1a58-4e6e-be7b-7df64d0fb676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:07.982344 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b5c6f-1a58-4e6e-be7b-7df64d0fb676 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:07.992714 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1461/2916] 10.222.0.91 () {58 vars in 1121 bytes} [Mon Feb 21 01:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 01:49:07.996907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:08.006932 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3473b-66da-4bda-ae0c-f616449f7b77 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:08.012265 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:08.013069 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:08.013355 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:08.013635 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] PATH_INFO: `/v3/projects/6e3c0645abf3476a88874154502dcca2/users/94eb7af69aa04d44991a181e06096292/roles/d866912b115b4ffd92d5011a81e30fc3` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:08.028489 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3c0645abf3476a88874154502dcca2, user_id=94eb7af69aa04d44991a181e06096292, role_id=d866912b115b4ffd92d5011a81e30fc3)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:08.031227 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:08.116390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1456/2917] 10.222.0.91 () {60 vars in 1482 bytes} [Mon Feb 21 01:49:07 2022] PUT /identity/v3/projects/6e3c0645abf3476a88874154502dcca2/users/94eb7af69aa04d44991a181e06096292/roles/d866912b115b4ffd92d5011a81e30fc3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 01:49:08.126707 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748edb-dd65-4345-a958-f3417498efab None None] REQUEST_METHOD: `POST` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:08.126999 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748edb-dd65-4345-a958-f3417498efab None None] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:08.127279 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748edb-dd65-4345-a958-f3417498efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:08.156328 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.auth.core [None req-d0748edb-dd65-4345-a958-f3417498efab None None] MFA Rules not processed for user `94eb7af69aa04d44991a181e06096292`. Rule list: `[]` (Enabled: `True`). {{(pid=79591) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:49:08.157571 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d0748edb-dd65-4345-a958-f3417498efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:08.221564 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1462/2918] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:49:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:49:08.232047 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:08.233752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:08.288247 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d8cf-39d0-4c04-b12b-e1124e9799f0 admin admin] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:08.291986 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84b0c7-11dd-4388-b722-ceeaf0606f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c90c0c26a544e089b126df43151e6f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:08.292620 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84b0c7-11dd-4388-b722-ceeaf0606f48 service cinder] REQUEST_METHOD: `GET` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:08.292907 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84b0c7-11dd-4388-b722-ceeaf0606f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:08.293187 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84b0c7-11dd-4388-b722-ceeaf0606f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:08.301302 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84b0c7-11dd-4388-b722-ceeaf0606f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:08.302723 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84b0c7-11dd-4388-b722-ceeaf0606f48 service cinder] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:08.311423 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1457/2919] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:49:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:49:08.654501 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748edb-dd65-4345-a958-f3417498efab None None] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:08.656117 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-d0748edb-dd65-4345-a958-f3417498efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:08.719653 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748edb-dd65-4345-a958-f3417498efab None None] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:08.724203 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:08.725056 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:08.725337 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:08.725613 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] PATH_INFO: `/v3/users/48fb8f0682594fe8acc450736c5ea23c` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:08.726784 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fb8f0682594fe8acc450736c5ea23c)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:08.729329 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:08.949581 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fb8f0682594fe8acc450736c5ea23c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:08.956302 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fb8f0682594fe8acc450736c5ea23c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:08.969038 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fb8f0682594fe8acc450736c5ea23c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:08.969260 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fb8f0682594fe8acc450736c5ea23c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:08.969846 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fb8f0682594fe8acc450736c5ea23c'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:09.048608 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1463/2920] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:49:08 2022] DELETE /identity/v3/users/48fb8f0682594fe8acc450736c5ea23c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:49:09.054811 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:09.055106 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:09.055390 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:09.073441 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:49:09.075027 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:09.134117 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1458/2921] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:49:09.143748 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:09.145317 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:09.202416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e821419-42cb-454a-ac96-cb7da24ae1ab admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:09.206430 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:09.207228 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:09.208418 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:09.208826 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:09.219944 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:09.232343 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:09.241242 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1464/2922] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:49:09.629368 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:09.630854 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:09.643805 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8678aa-6710-4a38-ab18-02443e3782bf None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:09.649030 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:09.649469 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:09.649751 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:09.650031 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] PATH_INFO: `/v3/projects/96775a20b26340d9b854af29743fbffa` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:09.652864 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96775a20b26340d9b854af29743fbffa)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:09.654969 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:09.753351 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96775a20b26340d9b854af29743fbffa', 'request_id': 'req-4199b5d6-786d-4ac3-915e-5e6e888b6521'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:09.764517 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96775a20b26340d9b854af29743fbffa', 'request_id': 'req-4199b5d6-786d-4ac3-915e-5e6e888b6521'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:09.770099 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96775a20b26340d9b854af29743fbffa', 'request_id': 'req-4199b5d6-786d-4ac3-915e-5e6e888b6521'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:09.833013 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] The token cache is being invalidate because project 96775a20b26340d9b854af29743fbffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:49:09.833471 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:09.834188 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-4199b5d6-786d-4ac3-915e-5e6e888b6521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:09.835806 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1459/2923] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:49:09 2022] DELETE /identity/v3/projects/96775a20b26340d9b854af29743fbffa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:49:17.156704 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:17.158096 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:17.171164 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f3fa-4864-4aa4-ad44-d5e4fc31b56d service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:17.224101 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:17.224949 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:17.225230 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:17.225505 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] PATH_INFO: `/v3/users/94eb7af69aa04d44991a181e06096292` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:17.226658 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94eb7af69aa04d44991a181e06096292)` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:17.228584 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:17.473416 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94eb7af69aa04d44991a181e06096292'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:17.480159 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94eb7af69aa04d44991a181e06096292'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:17.492244 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94eb7af69aa04d44991a181e06096292'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:17.492915 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94eb7af69aa04d44991a181e06096292'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:17.493512 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.notifications [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94eb7af69aa04d44991a181e06096292'} {{(pid=79591) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:17.561309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1465/2924] 10.222.0.91 () {58 vars in 1223 bytes} [Mon Feb 21 01:49:17 2022] DELETE /identity/v3/users/94eb7af69aa04d44991a181e06096292 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:49:17.565826 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] REQUEST_METHOD: `POST` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:17.566296 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:17.566442 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:17.583666 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.auth.core [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] MFA Rules not processed for user `b9a601927c06447bab4cb7cd0ec12a02`. Rule list: `[]` (Enabled: `True`). {{(pid=79590) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 01:49:17.584901 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:17.642396 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1460/2925] 10.222.0.91 () {58 vars in 957 bytes} [Mon Feb 21 01:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 01:49:17.651940 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:17.654041 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:17.708309 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8238e-df7e-424a-85c4-ffd86c143714 admin admin] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:17.711895 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84fdc361782f47a2976d393a6b5e1397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:17.712531 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:17.712815 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:17.713093 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:17.722870 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:17.724406 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:17.733453 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1466/2926] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 01:49:18.138843 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] Authenticating user token {{(pid=79590) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:49:18.140345 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.fernet_utils [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79590) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:49:18.152530 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d811142-b0ae-45ae-ba13-d47e47007515 None None] Validating token access rules against request {{(pid=79590) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:49:18.157790 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9a601927c06447bab4cb7cd0ec12a02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '433e9f18a6614ea59825abd58da308b1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79590) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:49:18.158642 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:49:18.159552 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:49:18.159875 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] PATH_INFO: `/v3/projects/6e3c0645abf3476a88874154502dcca2` {{(pid=79590) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:49:18.161327 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3c0645abf3476a88874154502dcca2)` {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:49:18.163420 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] RBAC: Authorization granted {{(pid=79590) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:49:18.256431 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3c0645abf3476a88874154502dcca2', 'request_id': 'req-572ba4ee-b2c5-453a-a245-6da50a011bcf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:18.262340 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3c0645abf3476a88874154502dcca2', 'request_id': 'req-572ba4ee-b2c5-453a-a245-6da50a011bcf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:18.268324 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3c0645abf3476a88874154502dcca2', 'request_id': 'req-572ba4ee-b2c5-453a-a245-6da50a011bcf'} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:18.312801 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] The token cache is being invalidate because project 6e3c0645abf3476a88874154502dcca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79590) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 01:49:18.313111 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:18.313752 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: DEBUG keystone.notifications [None req-572ba4ee-b2c5-453a-a245-6da50a011bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79590) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 01:49:18.315380 dv-cinder-813227-6-iscsi devstack@keystone.service[79590]: [pid: 79590|app: 0|req: 1461/2927] 10.222.0.91 () {58 vars in 1232 bytes} [Mon Feb 21 01:49:18 2022] DELETE /identity/v3/projects/6e3c0645abf3476a88874154502dcca2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 01:52:58.565845 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] Authenticating user token {{(pid=79591) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 01:52:58.567776 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:52:58.670315 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab8c3-ed55-4a04-8b1a-409c974b71ec service neutron] Validating token access rules against request {{(pid=79591) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 01:52:58.728300 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e9442e0d7974df3984122cad45a0320', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af1f9f3926b4b1d94e6c597bf84917e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79591) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 01:52:58.728956 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] REQUEST_METHOD: `GET` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 01:52:58.729239 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] SCRIPT_NAME: `/identity` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 01:52:58.729523 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79591) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 01:52:58.731342 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.fernet_utils [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79591) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 01:52:58.743379 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 01:52:58.744965 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126053-d35d-4b32-8aa3-ac52888dfba5 service placement] RBAC: Authorization granted {{(pid=79591) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 01:52:58.755338 dv-cinder-813227-6-iscsi devstack@keystone.service[79591]: [pid: 79591|app: 0|req: 1467/2928] 10.222.0.91 () {60 vars in 1365 bytes} [Mon Feb 21 01:52:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)